Trupti Pradhan

I am currently responsible for developing a data lake on AWS.The technology stack includes AWS Glue,AWS EMR,AWS Elastic Search,AWS S3,AWS lambda,AWS redshift and redhsift spectrum.Being the alone team member I take care of the data operations part as well.For the infrastructure automation I am using AWS lambda and python boto3 library.Our data lake storage is on AWS S3 and the metadata catalog is AWS glue data catalog.The primary datawarehouse is AWS redshift and redshift spectrum.

In this job role I got exposure to client handling skills and cater the client's technical requirements specifically to bigdata,hadoop and cloud platforms.I got an exposure to develop and support data intensive real time streaming applications for clients like Nissan motors,Daimler and Martin Marietta materials.Regarding the technology stack I got an exposure to Apache Spark,spark streaming,Kafka,sqoop,Informatica,Hbase,spring boot etc.For hadoop distributions I got exposure to cloudera,hortonworks and AWS.

An analytic hub using Oracle bigdata appliance was developed to analyse customer keenness for ERP solutions.I got an exposure of writing pig scripts to do data transformation and quality.In order to cater the complex business requirements,pig UDF's using java were developed.Pentaho was used as an ETL tool to extract the data from mongo db and push the data to hadoop file system.As the data was present in json format,hence Twitter Elephant Bird was used parse the data and store it in hive external tables.

I was responsible for creating automated test cases in Silk Test using 4t scripting language.Apart from creating the automation framework I also got a exposure to HP-Quick Test Professional for automation testing and HP-Load Runner for load testing.I was also learnt the HP-Application life cycle management tool for test cases maintenance,test case coverage and bug tracking

As a software developer I was responsible for writing automated test cases using selenium and java.Apart from writing the test cases I was also responsible for doing regression testing ,unit testing and database testing.I joined the company as a entry level graduate and it was a really good learning experience.