Course Outline
Introduction to the Stratio Platform
- Examining Stratio's architecture and its core functional modules
- Understanding the role of Rocket and Intelligence within the broader data lifecycle
- Accessing the system and navigating the Stratio user interface
Utilizing the Rocket Module
- Establishing data ingestion channels and building processing pipelines
- Linking data sources and setting up transformation rules
- Employing PySpark to execute preprocessing tasks within Rocket
Core PySpark Concepts for Stratio Users
- Exploring PySpark data structures and fundamental operations
- Implementing control flow constructs: for loops, while loops, and if/else statements
- Defining custom functions using 'def' and applying them to data tasks
Advanced PySpark Integration with Rocket
- Managing streaming ingestion and real-time transformations
- Applying loops and functions in both batch processing and real-time scenarios
- Adopting best practices to optimize performance in PySpark pipelines
Delving into the Intelligence Module
- Reviewing capabilities for data modeling and analytical features
- Conducting feature selection, transformation, and exploratory analysis
- Leveraging PySpark for bespoke analytics and deriving insights
Developing Sophisticated Analytics Workflows
- Building user-defined functions (UDFs) specifically for the Intelligence module
- Integrating conditionals and loops to govern complex data logic
- Practical applications: customer segmentation, data aggregation, and predictive modeling
Deployment and Team Collaboration
- Saving, exporting, and reusing established workflows
- Facilitating collaboration with colleagues within the Stratio ecosystem
- Validating outputs and integrating results with downstream tools
Wrap-up and Future Directions
Requirements
- Proficiency in Python programming
- Foundational understanding of data analytics or big data processing principles
- Basic familiarity with Apache Spark and distributed computing concepts
Target Audience
- Data engineers developing solutions on Stratio-based platforms
- Analysts or developers actively utilizing the Rocket and Intelligence modules
- Technical teams in the process of migrating to PySpark workflows within Stratio
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.