Skill set (7)
Akshay Pabba in a few words
🚀 As a skilled data engineer, I'm like a 🛠️ builder in digital builder, transforming raw data into valuable insights that drive business success! With my expertise, I can help your organisation unleash the power of data. 💪
💡 Need help with data integration? No problem! I'll design robust data pipelines 📊 and ensure your data flows seamlessly from source to destination, like a well-oiled machine. ⚙️
🔍 Searching for actionable insights? I'll dig deep into your data 🕵️♂️, using powerful tools like SQL, Python, and Apache Spark to extract valuable nuggets of information that can boost your decision-making process. 💎
🏗️ Building scalable data architectures is my speciality! Whether it's on-premises or in the cloud ☁️, I'll construct a rock-solid foundation for your data, leveraging technologies like AWS or Azure. 🏰
🧹 Worried about data quality? Don't be! I'll clean, validate, and ensure the integrity of your data, leaving no room for errors. 🧹✨
🤝 Collaboration is key! I love working in cross-functional teams, bridging the gap between business and technology, and delivering solutions that meet your unique needs. 🤝
🔒 Security is always a top priority. I'll implement stringent measures to protect your data, making sure it stays safe from prying eyes. 🛡️
📚 I'm a lifelong learner, staying up to date with the latest trends and technologies in the data engineering world. I'll bring the most innovative approaches to your project, tailored specifically. 🌟
✨ With my comprehensive skill set, attention to detail, and passion for data, I'm confident we can achieve remarkable results together. Let's embark on this data-driven journey and unlock the full potential of your business! 🚀💼
🔑 Your data holds the key to success. Let's unlock its potential together! 🔓💡
Experience
- Vibric Consulting Ltd.Data EngineerJuly 2022 - Today (2 years and 5 months)London, UK• Developed various functionalities for Data Ingestion framework using Python.• Created the Json configuration files for cleansing the data through generic Spark framework.• Developed the Spark SQL/Databricks Jobs and processed the data in Amazon S3 with complex business requirements for Data Marts creation for various markets.• Developed various python functions used while data cleansing and data transformations.• Have processed the master reference data with SCD2 implementation using Spark.• Have scheduled daily, weekly & monthly workflows for Spark jobs using AWS Glue and created CRON jobs as well in some cases and scheduled.• Have processed history & incremental data using Spark and used Redshift for data validation & for historical data processing.
- TBAData EngineerAugust 2020 - June 2022 (1 year and 10 months)London, UK• Analyzing the data of source systems and mapping the data to our target WMS which contains 9 consolidated WMS tables.• Mapping of data to consolidated WMS tables from different sources by applying various joining logics.• Impala table creation scripts have been generated through this spreadsheet which contains consolidated tables information.• Analysis the data loaded into the consolidated WMS tables.• Validated the consolidated WMS through paper-works/Invoices.
1 recommendation
SB
Sirisha Bingi recommend Akshay Pabba
06/06/2023
Very Productive