Data Engineering Team Lead
【THE ROLE & THE TEAM】 As the Data Team Lead at JKOPay, you will take on a leadership role in managing and mentoring the Data Engineering team. You will be responsible for overseeing the design, development, and maintenance of JKOPay’s data systems, including both real-time and batch processing. With JKOPay handling over 3 billion transactions monthly for more than 6 million users in Taiwan, your leadership will be crucial in ensuring data accuracy, scalability, and efficiency. A significant aspect of this role involves infrastructure planning and development. You will lead the team in architecting and optimizing data infrastructures to ensure scalability, high availability, and performance across multiple platforms and environments. Collaborating closely with cross-functional teams, you will guide the implementation of infrastructure solutions that support the rapid growth of JKOPay’s business and evolving data needs. This is a strategic position that will allow you to shape the future of JKOPay's data infrastructure while supporting the growth of the team and organization. 【WHY YOU SHOULD BE INTERESTED】 -Lead and mentor a team of data engineers in building and maintaining scalable ETL pipelines, ensuring data integrity and security. -Drive infrastructure planning and design for data platforms to ensure performance, scalability, and reliability. -Collaborate with business and engineering teams to define data requirements, design data models, and drive the development of data products. -Lead efforts in optimizing data systems for performance, scalability, and cost-efficiency across multiple environments, including cloud (GCP) and on-premises data centers. -Oversee the entire lifecycle of data projects, from conception to deployment, ensuring timely and high-quality delivery. -Take ownership of the continuous improvement of JKOPay’s data infrastructure and engineering practices to meet the needs of a rapidly growing business. -Provide technical guidance on the adoption of new technologies and data platforms to drive innovation in the team. 【WE'D LOVE TO MEET YOU IF】 -You have 5+ years of relevant experience in data engineering, including at least 2 years of team leadership or mentorship experience. -Proven track record of designing, building, and maintaining complex ETL pipelines with a focus on scalability, reliability, and security. -Strong proficiency in backend development with expertise in shell scripting, SQL, and at least one programming language (e.g., Python, Scala). -Expertise in distributed computing engines and platforms (e.g., ClickHouse, PySpark, Kafka, BigQuery, Airflow). -Demonstrated experience in planning and implementing infrastructure for large-scale data processing and storage solutions. -Familiarity with data exploration and visualization tools (e.g., Superset, Tableau) and experience in implementing data lake and data warehouse architectures. -Practical experience with cloud-based data processing solutions (e.g., AWS Data Pipelines, GCP Dataflow). -Practical experience with CDC (Capture Data Change) tools and methodologies, or any other streaming solutions. -Experience in managing stakeholders at different levels, with excellent interpersonal and communication skills. -Previous experience in setting up or utilizing Data Catalogs is a plus. -Passion for team development, fostering a collaborative and high-performance culture.公司地址:
台北市松山區長安東路二段225號8樓(C棟)其他:
None-2024-09-17