- Blog
- CV generator
- Community
- Documentation
Kaustabh Ganguly
Kolkata, India
PROFILE: ------------ Experienced Data Engineer with a proven track record of designing, developing, testing, and debugging of new & existing ETL pipelines. Adept at developing Control-m based solutions for integrating & migrating data in AWS Redshift environments. Very strong in python and have good grip on different data structures and algorithms. KEY SKILLS: --------------- - Python - Data Warehousing - SQL (Redshift/PostgreSQL) - Control-m - Version Control (BitBucket/GitHub) - Jira / Agile Methodologies - Also comfortable with C/C++/Java/JavaScript/Go/Kotlin - Linux Fundamentals (CentOS/RHEL) WORK EXPERIENCE: ----------------------- •Daily tasks include building back-end views in Redshift DB for Tableau dashboards, ingestion of new files & maintaining ETL pipelines with a Python based internal framework in a fully mature Agile process. Experienced with - Control-M job scheduling tool, Amazon Redshift, S3, CICD using Jenkins, BitBucket, Git. Experienced with IDEs like VS Code, PyCharm, DataGrip, SQL Workbench & tools like PuTTY, WinScp, Cloudberry among others. Contributed to some PoCs with Apache Pinot and worked on Alation Data Catalogue as a data steward. •Optimized multiple existing queries that decreased query time by an average of ~15%. Created automation scripts using multiprocessing and redshift_connector API in python to execute unload and copy commands in parallel between prod and qa databases, which reduced overall time consumption of the whole task by ~300%. Created cronjobs and python scripts using boto3 which takes latest daily prod files in s3 bucket and copies them in qa bucket so that our team doesn’t have to login and place files manually, which saved everyone’s time. •Talking to stakeholders for requirement gathering and collaboration. Helping and reviewing others’ work/documentation and interviewing/giving KT to new joiners. Good grip on the whole SDLC process from build to deploy in production with thorough documentation. Handled more than 25 production releases and bug/rework was confined to <5% to date. •Alongside development work, also worked as a Tester (SDET) and done SIT for more than 10 production releases using Jira X-Ray and manual testing. While testing all bugs were spotted and communicated to the developer which resulted in a total of 0% rework for those releases.
CodersRank Score
What is this?
This represents your current experience. It calculates by analyzing your connected repositories. By measuring your skills by your code, we are creating the ranking, so you can know how good are you comparing to another developers and what you have to improve to be better
Information on how to increase score and ranking details you can find in this blog post.
102.7
CodersRank Rank
Top 5%
Top 50
Kivy
Developer
India
Top 100
R
Developer
India
Highest experience points: 0 points,
0 activities in the last year
HTML
22.8
exp.
JavaScript
16.6
exp.
Python
15.4
exp.
Jupyter Notebook
13.2
exp.
CSS
11.1
exp.
Java
7.6
exp.
Batchfile
3
exp.
JSON
2.7
exp.
C++
2.1
exp.
Shell
2
exp.
SCSS
1.5
exp.
List your work history, including any contracts or internships
Johnson & Johnson
Jan 2021 - Apr 2023 (2 years 3 months)
Data Engineer (Contractor)
Day to day tasks include building back-end views for Tableau dashboards, ingestion of new files & maintaining ETL pipelines with Redshift SQL & python based internal framework in a fully mature Agile process. Experienced with - Control-M job scheduling tool, Amazon Redshift, S3, CICD using Jenkins, BitBucket, Git. IDEs like PyCharm, DataGrip, SQL Workbench & tools like Putty, WinScp, Cloudberry among others. Contributed to some PoCs with Apache Pinot & Rasa chatbot framework. Optimized multiple queries that decreased query time by an average of ~15%. Talking to stakeholders for requirement gathering and collaboration. Helping and reviewing others’ work/documentation and giving KT to new joiners. Good grip on the whole SDLC process from build to deploy in production with thorough documentation. Handled more than 25 production releases and bug/rework was confined to <5% to date. Alongside developer, also worked as a Tester (SDET) and done SIT for more than 10 production releases using Jira X-Ray. While testing all bugs were spotted and communicated to the developer which resulted in a total of 0% rework for those releases.
Tata Consultancy Services
Oct 2020 - Apr 2023 (2 years 6 months)
System Engineer
-> Received training on Product Design and Development as part of EIS (Engineering and Industrial Services) training. Designed and created prototype of a smart shower system with SWOT, PESTLE, Scenario Planning, Critical Success Factor Analysis and The Five Forces methods analysis. I leaded the team and we did thorough market research. My team worked hard to come up with a well researched and analyzed product which won the best product award during our Initial Learning Program (ILP).
-> Did courses on Security, Business and several other corporate mandatory processes. Joined Johnson and Johnson as a contractor being sponsored by TCS. Working as a data engineer since then. Rest of the work details are in J&J section in my profile.
-> Did courses on Security, Business and several other corporate mandatory processes. Joined Johnson and Johnson as a contractor being sponsored by TCS. Working as a data engineer since then. Rest of the work details are in J&J section in my profile.
Param.ai
Jun 2018 - Jul 2018 (1 month)
Machine Learning Intern
Worked extensively with Natural Language Processing and Attention Networks and added value to the models that are used by the company .
This section lets you add any degrees or diplomas you have earned.
Kalyani Government Engineering College
Bachelor of Technology - BTech, Information Technology
Jan 2016 - Jan 2020
[PCAP-31-03] PCAP – Certified Associate in Python Programming
Mar 2023
EF Standard English Test (C2 Proficient)
Feb 2023
Journaling Mastery: Become Your Best Self
May 2022