HackerTube

THE VIDEO SHELF · parallel task scheduling

Shared memory parallelism in Julia | Kiran Pamnany | Cambridge Julia Meetup (May 2018)

Kiran Pamnany's Cambridge Julia Meetup talk on Julia's shared memory parallelism and its new task scheduler. It argues that fork-join and work-stealing models nest poorly and presents depth-first scheduling for composable parallelism.

Why HN readers recommended it

Recommended in Julia threading threads as an insightful, simple explanation of the new task scheduler.

This is a summary from the source dataset, not an endorsement by Hacker News or the video creator.

Video & recommendation details

Creator / channel
The Julia Programming Language
Topic
parallel task scheduling
Format
talk
Level
advanced
HN recommenders in dataset
4
HN mentions in dataset
5
Recommendation years in dataset
2018–2019

These counts and years describe the included Hacker News records; they are not YouTube views or the video’s publication date.

From the original HN conversations

Excerpts from the recorded comments. Follow each source for the full comment and surrounding discussion.

  • This work has been a monumental collaborative effort and I think the eventual outcome will be pretty spectacular. I gave a talk at an MIT Julia meetup a few months ago that the author of this PR also spoke at; I found his talk to …

    jrevels on Hacker News · 2018-10
    In Julia parallel task runtime (WIP)
  • checkout [VIDEO] which explains the new features of the task scheduler in a simple fashion. Basically Julia is employing a new algorithm to schedule tasks, where traditional methods would get stuck/blocked. Essentially, if you run a job with parallel tasks and one of the threads …

    boromi on Hacker News · 2018-10
    In Julia parallel task runtime (WIP)
  • Consider a machine with N cores running a program which spawns N parallel tasks, each of which in turn spawns N parallel tasks. Which subtasks do the cores work on initially? If it's the first subtask of each top-level task, that's breadth-first scheduling. If it's …

    StefanKarpinski on Hacker News · 2019-07
    In Composable multi-threaded parallelism in Julia

Summaries, classifications and recommendation records are from the HackerTube source dataset. Read about this library and its limitations.