Hi, I'm Arul Software Developer

✔️ 7+ years of experience in IT as a Software developer and SRE in software cycle encompassing analysis, design, development, unit testing, and implementation.

✔️ Certified Azure Data Engineer with Hands-on experience on Azure Data factory,Azure Synapse Analytics and Azure Data Bricks.

ABOUT

Education

Bachelor of Engineering in Electrical and Electronics Engineering

Velammal Engineering College, Anna University (2011 - 2015)

Experience

Senior Associate / SRE

Cognizant technology Solutions (2015 - 2020)

Site downtime can lead to loss of revenue, reputational damage and severe distress. Availability monitoring prevents adverse situations by checking the uptime/availability of Application (WebUI/API's) and notifying the Support team and stakeholders of problems before they impact on business and which in turn will provide the advantages of early detection of Problems, Real-time Notifications, Avoid Network Outages, Avoid DB/Service outages, Improve Reliability of your application, Avoid SSL relates issues , Enhanced End-User Experience.

Associate / ETL - Tableau Developer

Cognizant technology Solutions (2020 - 2023)

Regulatory Reporting application that caters to the Regulatory & Liquidity Reporting requirements for instruments traded by organization in the specific Region. In addition, it supports daily/monthly Liquidity Reporting for financial regulators such as the Financial Services Authority

TECH STACK
ETL

Datastage, Informatica Powercentre, Azure Data factory, Azure DataBricks

Reporting

Tableau, Webfocus

Automation

Ansible, UCD

Language

Python, Java, pyspark

Frameworks

Spring, Kafka, spark, ELK

Cloud

Azure, OCP, PCF

CERTIFICATIONS
Azure Certified Data Engineer
View Certificate
Designing Microsoft Azure Infrastructure Solutions
View Certificate
Azure Fundamentals
View Certificate
WORK

🚧 Spring Projects

  • Automation Log API - Built using Java spring boot framework an API to consolidate all automations executed and report in Kibana Dasboard
  • Operational Event Bus - Built using Java spring boot framework & Kafka for processing events in Real-time

🚧 Tableau Reports

  • Developed SLA Reports
  • Developed Feed Availability Dashboard Reports
  • Developed Data Sanity Story Reports
  • Developed RAG Reports (Linear regression)
  • Developed OLA/KPI Trend line & Heat map Reports

🚧 Ansible Projects

  • Automation of File beat installation
  • Automation of Restarting applications/services running in Pivotal cloud foundry
  • Automation of Disk space cleanup on Linux servers
  • Self­healing automation solution for restarting services in Windows servers
  • Automation of File beat installation

🚧 Python Projects

  • Spark Monitoring - Built using python for monitoring/alerting long running spark jobs by monitoring the spark history server API's
  • KPI Monitoring - Built using python for extracting/processing data from PostgreSQL/Vertica and post them to an API

🚧 ETL Projects

  • Informatica Powercentre - Development, enhancement of Informatica mapping to support data extraction, transformation and loading (SCD), Performance tuning, administration, Migration , Reverse engineering and production support
  • Unix Automations - Automated Data backup, Data restore on Sybase & Unix scripts to copy file's from production, file transfer between servers using SFTP and FTP
  • Datastage Migration - Datastage migration from 8.5 to 11

🚧 Azure Projects

  • Implemented data transformations and ETL processes in Azure Databricks to optimize data ingestion and transformation
  • Designed and implemented complex data orchestration workflows in Azure Data Factory, including data dependencies and conditional execution for robust data pipelines
  • Integrated data from diverse sources, including on-premises databases, cloud storage, and external APIs, into Azure Data Factory and Azure Databricks for unified data processing
  • Leveraged Azure Data Lake Storage for efficient data storage and integrated it seamlessly with Azure Data Factory and Azure Databricks for data processing
  • Utilized parameterization techniques in Azure Data Factory for pipeline reusability, allowing for efficient management of multiple environments and configurations
  • Implemented robust security measures, including Azure Key Vault integration, to protect sensitive data throughout the data processing lifecycle
  • Set up CI/CD pipelines for Azure Data Factory to automate testing and deployment of data pipelines, ensuring consistency and reliability
CONTACT

Interested in working together? Let's talk