Deep Dive into Project Tungsten: : Bring Spark Closer to Bare Metal / Rosen, Josh.

Format:

Video

Author/Creator:

Rosen, Josh, author.

Language:

English

Subjects (All):

Spark (Electronic resource : Apache Software Foundation).

Genre:

Electronic videos.

Physical Description:

1 online resource (1 video file, approximately 34 min.)

Edition:

1st edition

Other Title:

Bring Spark closer to the bare metal

Place of Publication:

O'Reilly Media, Inc., 2015.

System Details:

video file

Summary:

Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications, to push performance closer to the limits of modern hardware. This effort includes three initiatives:1. Memory Management and Binary Processing: leveraging application semantics to manage memory explicitly and eliminate the overhead of JVM object model and garbage collection2. Cache-aware computation: algorithms and data structures to exploit memory hierarchy3. Code generation: using code generation to exploit modern compilers and CPUsProject Tungsten will be the largest change to Spark’s execution engine since the project's inception. In this talk, we will give an update on its progress and dive into some of the technical challenges we are solving.

Participant:

Presenter, Josh Rosen.

Notes:

Online resource; Title from title screen (viewed September 3, 2015)

Title from title screen (viewed January 28, 2016).

OCLC:

936180090