Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Distributed File Systems Made Easy with Python's fsspec

Conf42 via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
This conference talk from Conf42 Python 2025 explores how to simplify distributed file system management using Python's fsspec library. Learn how to transition data workflows to the cloud, overcome integration challenges, and leverage fsspec for seamless file system operations. Guy Hardonag demonstrates practical implementations with LakeFS, showing how fsspec provides a unified interface for working with various storage backends. The 19-minute presentation includes a hands-on demonstration that showcases real-world applications of these technologies, making complex distributed storage systems more accessible to Python developers.

Syllabus

00:00 Introduction to LakeFS and Data Management
00:16 Transitioning Data Workflows to the Cloud
02:54 Challenges and Solutions in Cloud Integration
04:19 Introduction to FSSpec
09:19 Implementing FSSpec for LakeFS
12:24 Practical Demonstration with LakeFS and FSSpec
17:18 Conclusion and Q&A

Taught by

Conf42

Reviews

Start your review of Distributed File Systems Made Easy with Python's fsspec

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.