_spark-sql-adaptive-execution-unleashes-the-power-of-cluster-in-large-scale-carson-wang-intel-and-yuanjian-li-baidu.jpg "Spark SQL Adaptive Execution Unleashes The Power of Cluster in Large Scale Carson Wang (Intel) and Yuanjian Li (Baidu) from full form of spark Video Screenshot Preview")
GalleryPlay Video:
(Note: The default playback of the video is HD VERSION. If your browser is buffering the video slowly, please play the REGULAR MP4 VERSION or Open The Video below for better experience. Thank you!)
⏲ Duration: 15 min 46 sec
✓ Published: 11-Jun-2018
✓ Published: 11-Jun-2018
Description:
Spark SQL is a very effective distributed SQL engine for OLAP and widely adopted in Baidu production for many internal BI projects. However, Baidu has also been facing many challenges for large scale including tuning the shuffle parallelism for thousands of jobs, inefficient execution plan, and handling data skew.nnIn this talk, we will explore Intel and Baidu’s joint efforts to address challenges in large scale and offer an overview of an adaptive execution mode we implemented for Baidu’s B
Spark SQL is a very effective distributed SQL engine for OLAP and widely adopted in Baidu production for many internal BI projects. However, Baidu has also been facing many challenges for large scale including tuning the shuffle parallelism for thousands of jobs, inefficient execution plan, and handling data skew.nnIn this talk, we will explore Intel and Baidu’s joint efforts to address challenges in large scale and offer an overview of an adaptive execution mode we implemented for Baidu’s B
Share with your friends:
Whatsapp | Viber | Telegram | Line | SMS
Email | Twitter | Reddit | Tumblr | Pinterest
Related Videos
_what-is-spark.webp "Learnomate Technologies")
_learn-apache-spark-in-10-minutes-124-step-by-step-guide.webp "Darshil Parmar")
_92.webp "Help us win finishing funds with one click https://www.seedandspark.com/studio/the-great-flip-offnRingling Bros. eliminate their three-ring circus, marking an end in entertainment history –– the death of the original circus act.")
_taxes-not-knowing-this-will-cost-you-124-doordash-uber-eats-grubhub-spark-driver-shipt.webp "Ride Along With Bri")
⏲ 6 minutes 34 seconds 👁 22.8K
_promising-female-prodigy-sarah-diaz-debuts-her-new-song-2-luv-u.webp "Promising Female Prodigy Sarah DiaznSarah Diaz, a 19-year-old singer/songwriter from Lafayette, Louisiana, is ecstatic as she embarks on her new adventure as an aspiring female pop star with nothing but big aspirations and incredible musical abilities to back her up. She wants her music to reflect the kind and fearless attitude of the young woman who is more than ready to take on the world. Sarah Diaz has started on the right foot with what is one of the most original and passion-full tracks I'v")
_hunt-for-the-kentucky-wildman-124-bigfoot-expedition-bigfoot-documentary-movie-shorts-fyp.webp "Kentucky Bigfoot Research Organization")
⏲ 1 hour 26 minutes 52 seconds 👁 1.3K
_jamie-raskin-absolutely-crushed-this-republican-stooge.webp "TYT Investigates")
_smacc-dub-openening.webp "SMACCDUB Opening CeremonynnSummary by: Oli FlowernnThe opening ceremonies for SMACC have become anticipated events in their own right. With the hype that preceded SMACCDUB, there was pressure to deliver, and this SMACC did...n nAs the 2000 strong SMACCDUB crowd poured into the Dublin Convention Centre's steeply raked and tiered arena the lights were low and a DJ set by Jamie XX played in the background. Pitch darkness enveloped the completely full auditorium and so it begins.n nIn the darkness,")
_what-is-spark.jpg)
_learn-apache-spark-in-10-minutes-124-step-by-step-guide.jpg)
_92.jpg)
_taxes-not-knowing-this-will-cost-you-124-doordash-uber-eats-grubhub-spark-driver-shipt.jpg)
_promising-female-prodigy-sarah-diaz-debuts-her-new-song-2-luv-u.jpg)
_hunt-for-the-kentucky-wildman-124-bigfoot-expedition-bigfoot-documentary-movie-shorts-fyp.jpg)
_jamie-raskin-absolutely-crushed-this-republican-stooge.jpg)
_smacc-dub-openening.jpg)
![[+]](/images/menu.gif){kind=small}