Big Data Engineer ($2000 - $4000)
Mức lương: Trên 30 triệu
Đã hết hạn nộp hồ sơ - 166 lượt xem
Ngày cập nhật: 01/02/2019
Thông Tin Tuyển Dụng
Mô tả công việc
The Job
Trusting Social is looking for a passionate and committed Big Data Engineer who will work on the Data processing platform (Trust-Data) for collecting, storing, processing, and analysing huge data sets. The primary focus will be on designing and developing optimal solutions to launch and use them for the deep analysis by the Data Scientists of Trusting Social. Post the launch the ownership and onus of maintaining, enhancing, and monitoring lies with you. You will also be responsible for integrating them with the architecture used across the company. Why is this job key to Trusting Social - The data sets that are ingested and transformed by the Data engineering team form the crux of the source for the Data scientists at Trusting Social, who would then run their complex algorithms and routines on the quality output enabled by the Trust-Data Engineering team.
Key Job Responsibilities :
A Data engineer in TrustinSgocial works on the data pipeline infrastructure that is veritably the backbone of our business. In a day's job you would be writing elegant functional SCALA code to crunch TBs of data on Hadoop clusters, mostly using Spark. In a week's job, you would be owning a data pipeline deployment to clusters : on-prem or AWS or Azure or more. In a month's job, you would be managing Hadoop clusters right from security to reliability to HA. Did we mention we are building a pluggable,unified data-lake from scratch? Time to time you have new challenges for automating and scaling tasks for Data science team. We constantly look to improve our framework and pipelines, hence learning on the job is sort of a given. This is the big picture of our big data system.
Our expertise and requirements include but are not limited to Spark, Scala, HDFS, Yarn, Hive, Kafka, Distributed Systems, Python, Datastores (Relational and NoSql) and Airflow.
Trusting Social is looking for a passionate and committed Big Data Engineer who will work on the Data processing platform (Trust-Data) for collecting, storing, processing, and analysing huge data sets. The primary focus will be on designing and developing optimal solutions to launch and use them for the deep analysis by the Data Scientists of Trusting Social. Post the launch the ownership and onus of maintaining, enhancing, and monitoring lies with you. You will also be responsible for integrating them with the architecture used across the company. Why is this job key to Trusting Social - The data sets that are ingested and transformed by the Data engineering team form the crux of the source for the Data scientists at Trusting Social, who would then run their complex algorithms and routines on the quality output enabled by the Trust-Data Engineering team.
Key Job Responsibilities :
A Data engineer in TrustinSgocial works on the data pipeline infrastructure that is veritably the backbone of our business. In a day's job you would be writing elegant functional SCALA code to crunch TBs of data on Hadoop clusters, mostly using Spark. In a week's job, you would be owning a data pipeline deployment to clusters : on-prem or AWS or Azure or more. In a month's job, you would be managing Hadoop clusters right from security to reliability to HA. Did we mention we are building a pluggable,unified data-lake from scratch? Time to time you have new challenges for automating and scaling tasks for Data science team. We constantly look to improve our framework and pipelines, hence learning on the job is sort of a given. This is the big picture of our big data system.
Our expertise and requirements include but are not limited to Spark, Scala, HDFS, Yarn, Hive, Kafka, Distributed Systems, Python, Datastores (Relational and NoSql) and Airflow.
Yêu cầu ứng viên
• Proficiency with Hadoop v2, MapReduce, HDFS
• Experience with Spark and its latest features
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience with Big Data ML tool kits, such as Mahout, SparkML, or H2O
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Cloudera and Horton works
• BS or MS in CS
• At least 2 years of experience as software architect for large-scale enterprise software solutions
Top 3 Reasons To Join Us
• Reshape the Future of Banking
• Be Part of an Unicorn Startup
• Top Salary, Awesome Benefits
Why You'll Love Working Here
• Top market salary
• Generous comprehensive optional health insurance package for family
• Free premium gym membership
• Free Grab to work
• Housing allowance if moved closer to office
• Experience with Spark and its latest features
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience with Big Data ML tool kits, such as Mahout, SparkML, or H2O
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Cloudera and Horton works
• BS or MS in CS
• At least 2 years of experience as software architect for large-scale enterprise software solutions
Top 3 Reasons To Join Us
• Reshape the Future of Banking
• Be Part of an Unicorn Startup
• Top Salary, Awesome Benefits
Why You'll Love Working Here
• Top market salary
• Generous comprehensive optional health insurance package for family
• Free premium gym membership
• Free Grab to work
• Housing allowance if moved closer to office
Quyền lợi được hưởng
- Generous comprehensive optional health insurance package for family
- Housing allowance if moved closer to office
- Housing allowance if moved closer to office
Cách thức ứng tuyển
Hồ sơ theo yêu cầu của nhà tuyển dụng khi liên hệ trực tiếp
Giới thiệu về công ty
TRUSTING SOCIAL
Người liên hệ: HR Department
Người liên hệ: HR Department
Trusting Social is a Fintech and AI company that pioneers alternative credit scoring for emerging markets using telecom data and other new data sources. We aim to provide 1 billion credit scores to the unbanked consumers who currently do not have access to formal credit. We target emerging markets worldwide, ...Chi tiết
Trusting Social is a Fintech and AI company that pioneers alternative credit scoring for emerging markets using telecom data and other new data sources. We aim to provide 1 billion credit scores to the unbanked consumers who currently do not have access to formal credit. We target emerging markets worldwide, with the initial focus on Southeast Asia and India. In Vietnam, Trusting Social currently provides credit scores to 60 million Vietnamese consumers. Our customers include some of the largest banks and consumer finance institutions (FIs) in Vietnam. Having commercialized our solution in Vietnam, we are now expanding to other Asian markets including Philippines, Indonesia, India, Thailand and Bangladesh. Trusting Social is comprised of Ph.D. data scientists from Stanford Research Institute, Microsoft, IBM etc., and banking leaders from Goldman Sachs, Credit Suisse, and Barclays. We are the Winner of the Future of Money and Technology Summit 2014 and the Winner of Innotribe Startup Showcase Asia 2015. Founded in Silicon Valley, Trusting Social is now headquartered in Singapore, with R&D lab in Ho Chi Minh, Melbourne, and offices in Hanoi, Manila, Jakarta, New Delhi, Pune, Mumbai, and Bangalore. Trusting Social is funded by top global venture capital firms. Ẩn chi tiết
Bạn đang xem tin việc làm Big Data Engineer ($2000 - $4000) trong ngành được tuyển dụng tại bởi TRUSTING SOCIAL. TRUSTING SOCIAL đang cần tuyển 0 người nhân sự với hình thức làm việc: Toàn thời gian cố định. Yêu cầu kinh nghiệm Không yêu cầu. Website tìm việc làm timviec24h.vn cập nhật tin Big Data Engineer ($2000 - $4000) cách đây lúc 07/08/2019 00:00:00. Người tìm việc lưu ý không nên đặt tiền cọc khi xin việc . Chúng tôi luôn cố gắng đưa tin tức tuyển dụng nhanh và chính xác nhất cho bạn.
Tìm thêm việc làm
TRUSTING SOCIAL
Địa chỉ:
Quy mô: Đang cập nhật
Việc làm tương tự
Big Data Engineer ($2000 - $4000)
Mức lương: Trên 30 triệu | Hạn nộp hồ sơ: Đã hết hạn nộp hồ sơ