senior big data infra engineer
1 day ago
About the Role:
We are seeking a highly skilled and experienced Senior Big Data Infra Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.
What you will be doing:
Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc to Build a reusable infra structure for stream and batch processing systems at scale.
Create automation, whether that is building DevOps pipelines, scripting or creating Infrastructure as Code in Terraform
Participating in work sessions with clients
Completing technical documentation
Requirements:
Experience in Developing and Scaling data Processing Systems This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark.
Expertise in public cloud services, Azure/AWS or GCP.
Experience with Cloud managed services and understanding of cloud-based messaging/stream processing systems are critical.
Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
Has knowledge in containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of applications.
Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
Proven experience in engineering stream/batch processing systems at scale.
Strong programming abilities in Java and Python.
Hands-on experience in public cloud platforms. Additional experience with other cloud technologies is advantageous.
Must Have:
Cloud Engineer Certification or other Cloud Professional level certification
4+ years of experience in customer-facing software/technology or consulting
4+ years of experience with "on-premises to cloud" migrations or IT transformations
4+ years of experience building, and operating solutions built on GCP or AWS/Azure
Technical degree: Computer Science, software engineering or related
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
-
Data Architect
22 hours ago
Remote, Vietnam Rackspace Full timeThis role will be working on a staffing project for Rackspace's client The SRE will be responsible for designing, implementing, and optimizing the infra-structure, tools and environment for Finance Data Repository (FDR). The position will involve working closely with Architects and Engineers on a day-to-day basis. Role and Responsibilities - Configure, and...
-
R-19462 Data Engineer Iii
3 days ago
Remote, Vietnam Rackspace Full timeDeep in 1 specific area (Power BI, ETL design, Visualization, Synapse SQL, Cloudera,Azure, Snowflake etc) or 1/more customers - Owner of the project (or module in case of large projects) for internal stakeholders (PMO, Principal etc) - Understands and communicates scope - Define and document approach and design (code / testing / migration) Explain scope /...
-
R-19094 Data Engineer Ii
3 days ago
Remote, Vietnam Rackspace Full timeCollaborate with customer to gather requirements and to understand their business processes. - Create and maintain optimal data pipeline architecture, - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data...
-
Data Engineer
2 weeks ago
Remote, Vietnam Sunbytes Full timeThis is a remote position. **About Sunbytes** Sunbytes is a leading **Tech & Talent Solutions** company known for innovative and scalable solutions. We focus on achieving goals for our partners and team members, delivering high-quality products and services, and fostering a supportive, challenging work environment. Our diverse team shares a common purpose,...
-
Senior System Engineer
7 days ago
Remote, Vietnam Pinnacle Full time**Job Title**: Senior System Engineer **Reports** **To**: Systems and Application Services **Location**: Remote **About us**: Welcome to Pinnacle, the ultimate destination for sports enthusiasts seeking an exhilarating sportsbook and gaming experience! Established in 1998, we have solidified our position as one of the globe's foremost licensed online gaming...
-
Data Engineer
7 days ago
Vietnam - Remote Rackspace Full time $80,000 - $140,000 per yearWe are looking for a highly skilled Azure Data Engineer with expert knowledge in cloud infrastructure and DevOps automation. This critical hybrid role will be responsible for designing, building, optimizing, and automating our entire end-to-end data platform within the Microsoft Azure ecosystem. The ideal candidate will ensure our data solutions are...
-
R-16794 Trainee Data Engineer
3 days ago
Remote, Vietnam Rackspace Full timeCollaborate with customer to gather requirements and to understand their business processes. - Create and maintain optimal data pipeline architecture, - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data...
-
Senior Rust Engineer
3 days ago
Remote, Vietnam Binance Full timeBinance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 230 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance...
-
Senior Frontend Engineer
2 weeks ago
Remote, Vietnam Sunbytes Full timeThis is a remote position. **About Sunbytes** Sunbytes is a leading Tech & Talent Solutions company known for innovative and scalable solutions. We focus on achieving goals for our partners and team members, delivering high-quality products and services, and fostering a supportive, challenging work environment. Our diverse team shares a common purpose,...
-
Senior Fullstack Software Engineer
22 hours ago
Remote, Vietnam Inspectorio Full time**About Inspectorio** Inspectorio is the leading AI-powered supply chain platform optimizing performance, building resilience, and providing intelligence across production chains for global brands, retailers, and their multi-tier suppliers. Our innovative platform seamlessly connects and digitizes supply chain processes to optimize decision-making, while...