DATA ENGINEER & DEVELOPER

Kannan A — Data Engineer & Cloud Developer

Building Production-Grade Data Pipelines & Cloud Solutions

Software Development Engineer specializing in data engineering, cloud architecture, and backend development. Experienced in building scalable data pipelines with Dagster, AWS services, and modern tech stack.

Kannan A Data Engineer and Cloud Developer Portfolio Photo

Experience

Building scalable solutions and data infrastructure

Ncompass Tech Studio Pvt. Ltd
Software Development Engineer I
Data Engineering & Analytics
Aug 2025 – Present
  • Built production data pipelines and centralized assets using Dagster and advanced SQL for a SaaS analytics platform
  • Architected serverless cloud data services using AWS Lambda, API Gateway, RDS, S3, EC2, ECS, and CloudWatch
  • Optimized database access with secure tunneling and DuckDB-based processing to improve system performance and scalability
Ncompass Tech Studio Pvt. Ltd
Software Engineering Intern
Apr 2025 – Jul 2025
  • Gained hands-on experience with Linux, Git, MySQL, Node.js, Express, and TypeScript for backend development
  • Built REST APIs and serverless applications using AWS SAM CLI, Lambda, and Docker
Andiran Health-tech Pvt. Ltd
Artificial Intelligence Intern
Jun 2024 – Aug 2024
  • Developed a 10,000+ image dataset for a real-time mood-board generation product using Stable Diffusion and OpenAI tools

Skills

Technologies and tools I work with

Data Engineering

Dagster PySpark Databricks DuckDB SQLAlchemy PyMySQL

Cloud & DevOps

AWS Lambda API Gateway S3 RDS EC2 ECS CloudWatch CodePipeline SAM CLI Docker

Programming Languages

Python SQL (MySQL) JavaScript TypeScript Java HTML5/CSS

Backend & Web

Node.js Express.js REST APIs React

AI/ML (Foundational)

Pandas NumPy Scikit-learn TensorFlow Computer Vision

Tools & Platforms

Git/GitHub VS Code Power BI Excel

Projects

Innovative solutions and technical implementations

Geo-based Infrastructure Issue Reporting

Built a live geolocation-based web platform to report infrastructure issues and dynamically fetch contextual representative data via public APIs. Integrated and validated multiple APIs for real-time data processing.

JavaScript APIs Geolocation Data Integration
View Project →

Recommendation Engine

Developed a web application with StreamLit for Qtuxathon 2024 Hackathon completed in under 24 hours. Earned recognition from Professors of Universiti Teknologi Petronas using collaborative filtering techniques.

Python NumPy TensorFlow Collaborative Filtering StreamLit
View Details →

Facial Emotion Recognition

Created a real-time StreamLit application that recognizes facial emotions using computer vision and deep learning techniques. Implemented with OpenCV, TensorFlow, and MediaPipe for accurate emotion detection.

Python OpenCV TensorFlow MediaPipe StreamLit
View Details →

Get In Touch

Open to opportunities and collaborations

Let's work together

I’m currently working as a Software Development Engineer with a focus on data engineering, backend systems, and cloud infrastructure. Feel free to reach out to discuss projects, technology, collaborations, or professional connections.