Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Overview of Huawei CloudMatrix
- CloudMatrix ecosystem and deployment architecture
- Compatible models, formats, and deployment modes
- Common applications and supported chipsets
Model Preparation for Deployment
- Exporting models from training frameworks (MindSpore, TensorFlow, PyTorch)
- Utilizing ATC (Ascend Tensor Compiler) for format translation
- Distinction between static and dynamic shape models
Deployment on CloudMatrix
- Creating services and registering models
- Deploying inference services through the UI or CLI
- Configuration of routing, authentication, and access controls
Handling Inference Requests
- Comparing batch and real-time inference workflows
- Data preprocessing and postprocessing pipelines
- Interacting with CloudMatrix services from external applications
Monitoring and Performance Optimization
- Analysis of deployment logs and request tracking
- Resource scaling and load balancing strategies
- Latency refinement and throughput enhancement
Enterprise Tool Integration
- Linking CloudMatrix with OBS and ModelArts
- Implementing workflows and model versioning
- CI/CD practices for model deployment and rollback
End-to-End Inference Pipeline
- Implementation of a complete image classification pipeline
- Performance benchmarking and accuracy validation
- Simulation of failover scenarios and system alerts
Conclusion and Future Pathways
Requirements
- Familiarity with AI model training processes
- Proficiency with Python-based machine learning frameworks
- Fundamental knowledge of cloud deployment principles
Target Audience
- AI operations teams
- Machine learning engineers
- Cloud deployment experts utilizing Huawei infrastructure
21 Hours
Testimonials (2)
The extensive selection of tools presented
Miruna Buzduga - Aeronamic Eastern Europe
Course - AI Enablement Training for Engineers
Step by step training with a lot of exercises. It was like a workshop and I am very glad about that.
