Ignite helps you run and manage multiple Spark jobs with variable environment on Google Dataproc. For development phase, the same can be simulated on Docker. User can also configure slack to get cluster status updates.
Features:
1. Manage Dataproc Cluster
2. Uploads Spark job code to GCS
3. Docker based Spark Job execution for development
4. Spark Job Submission
5. Slack Integration
By Vignesh Prajapati and Anirudha Vishvakarma
