Associate Data Engineer

• Collaborate with customer to gather requirements and to understand their b
• usiness processes.
• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / nonfunctional business requirements.
• Identify, design, and implement internal process improvements: automating
• manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and
• loading of data from a wide variety of data sources using
• Spark, SQL and Azure ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insi
• ghts into customer acquisition, operational efficiency and
• other key business performance metrics.
• Use tools to deploy and monitor the performance of the systems in producti
• on

• Demonstrate knowledge and real
• world experience on Big data technologies.
• A successful history of manipulating, processing and extracting value fro
• m large disconnected datasets.
• Advanced working SQL knowledge and experience working with relationa
• l databases, query
• authoring (SQL) as well as working familiarity with a variety of databases.
• Strong analytic skills related to working with unstructured datasets.
• Experience building and optimizing ‘big data’ data pipelines, architectures
• and data sets.
• We are looking for a candidate with > 2+ years of experience in a Data Eng
• ineer role. They should also have experience using the following software/
• tools:
• ○ Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL databases such as Oracle, SQL Server, My
• SQL or Postgres.
• Experience with data pipeline and workflow management tools: Azkaban,
• Luigi, Airflow,
• ○ Experience with stream-processing systems: Storm, SparkStreaming, etc.
• ○ Experience with objectoriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Some experience on visualization tools such as PowerBI/Tableau or other
• BI tools will be beneficial.

Kỹ năng:

• Big Data, 2 nămJava, 2 nămC++, 2 nămSql Server, 2 nămMySQL, 2
• nămEnglish, 2 năm

• 20,000,000 VND-30,000,000 VND
• Các chính sách theo pháp luật và cạnh tranh