Amith N.

I am an experienced data engineer with more than 3 years of experience in spark and Hadoop technology. I have experience in developing spark applications for the following purposes: 1. Ingesting big data. 2. Performing quality checks on the data. 3. Transform data into tidy data sets. 4. Reconciling Datasets. 5. Complex Aggregations on big data. I have spent a considerable amount of time understanding the internal workings of spark and hence I can help you solve any performance-related issues that you might be facing in your application as well. Thanks for viewing my profile