Training schedule
IN-COMPANY TRAINING PROGRAMS
Contact Giovanni Lanzani, if you want to know more about custom data & AI training for your teams. He’ll be happy to help you!
Check out more
Data Science mit Spark Kurs
Apache Spark ist eine leistungsstarke Open-Source Processing Engine, der für Tempo, Benutzerfreundlichkeit und fortgeschrittene Analytics entwickelt wurde. Mit Hilfe unserer erfahrenen Consultants werden Sie im Data Science mit Spark Kurs lernen, wie Sie das volle Potenzial dieses herausfordernden Tools nutzen und es für sich selbst einsetzen.
„Mir haben alle Aspekte des Kurses gefallen und ich möchte mich bei den Kursleitern bedanken. Sie haben uns toll erklärt, wie sich Spark für Data Science einsetzen lässt. Dies ist der vierte Kurs von GoDataDriven, an dem ich teilgenommen habe. Alle waren gut, aber dies war der bislang Beste.“ – Data Scientist, Knab
This training is for you if…
You have worked with Python before and you want to know how to scale to large datasets
You have started, or are about to start, working with large data
You know the concepts of machine learning and you want to know how to apply them at scale
This training is not for you if…
You won’t be working with spark but want to Python (check out the Python for Data Analysis training instead)
You want a deep dive into machine learning (check out the Certified Data Science with Python training instead)
Clients we've helped
What you'll learn
Spark basics
- Spark execution and the Spark session
- Transformations vs. actions
- Laziness and lineage: how Spark optimizes code
- How to use the Spark UI
DataFrames
- Spark DataFrames vs pandas DataFrames
- How to load and save DataFrames
- How to join data
- User-defined functions and pandas’ user-defined functions (with performance implications)
- Window operations
- How to apply partitioning and how Spark reads and writes data
- Shuffling, narrow wide operations, and thei impact on performance
- The catalyst optimizer
- About scheduling and job execution
- About caching and persistence levels
Spark.ml
- Machine learning with Spark
- Pre-processing data and feature engineering
- Model selection
- Pipeline API
- Advanced topics
The schedule
- Spark-Grundlagen
- Advanced Spark
- DataFrames
- Window-Funktionen
- Spark.ml
- Strukturiertes Streaming mit Spark
- Apache Spark mit Apache Kafka integrieren
After the training you will be able to:
- Process large-scale data using PySpark
- Understand the fundamentals of Apache Spark
- Perform machine learning on large-scale data
Structured, to-the-point, good combination of theory and practical examples, very knowledgeable trainer who can explain concepts very well
It was a hands-on and tangible course. We could apply what we learned in a matter of minutes. The trainer did a great job of answering ad-hoc questions that complemented the material. We appreciated the fact that we could apply what we were taught directly to our company.
I liked every aspect of this training and would like to thank the trainers. They did an excellent job of explaining how to use Spark for data science. This is the fourth GoDataDriven training I’ve followed. All were great, but this was the best one so far.
Climbing a steep Python and Machine Learning curve in three days. This would have taken me months on my own.
