Experienced Data Engineer with 2.5 years of experience in designing, building, and optimizing data pipelines using Apache Spark, PySpark, Trino, and other big data technologies. Proficient in backend development with Python frameworks like FastAPI and Flask. Adept at DevOps practices, containerization with Docker, and orchestration with Kubernetes for streamlined application deployment and management. Experienced with diverse databases, including IBM DB2, PostgreSQL, RedShift, MySQL, MongoDB, and Redis. Skilled in creating insightful data visualizations using Apache Superset and Streamlit. Proven ability to improve data processing efficiency, automate workflows, and enhance productivity through innovative solutions. Expertise in CI/CD pipelines and Kubernetes management.