23-07-2021
Platform Engineer (Zagreb)
* Please note that most of the time you’ll work fully remote, except in occasional circumstances.
Complex problems require the right expertise! Today, one of the biggest challenges lies in data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.
At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on capturing, ingesting, storing and managing critical data from huge clusters where the 3Vs are always present. As concerns technology stack, we take advantage of almost every state-of-the-art framework in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming languages to interact with them.
YOUR ROLE
As a Platform Engineer, you’ll play a vital role in several phases of the adoption of the Large Scale Data platforms in on-prem or Cloud contexts (Azure, AWS, GCP), participating in analysing, outlining and sizing distributed storage and/or computing systems, setup, upgrade, securitisation and tuning. For these critical systems, a particular focus on performance and security is crucial, as well as implementing the best service development practices to serve as the basis for monitoring tools.
Usually, this role also works closely with the development teams in designing, developing and installing application solutions, processing and storage.
Your daily activities will include:
- Setting up / upgrading / securitising/tuning platforms on a large scale in critical, ephemeral and/or self-scaling environments on both on-prem or in Cloud providers
- Implementing security rules and policies
- Recommending and periodically updating the best practices for data platforms (hotfixes, patches, etc.)
- Configuring best practices for monitoring the infrastructure
- Analysing hardware and software requirements for each project to be implemented
- Designing and developing new processes for better stability and performance maintenance of environments
- Developing integration or automation processes for Cloud deployments. Being able to turn to containerised environments on Kubernetes
- Participating and helping solve performance, scalability and security issues
// Stacks: Cloudera, Confluent, Azure Data Services, MongoDB, Kerberos ou Windows Active Directory
SKILLS YOU NEED TO HAVE
- MSc / BSc in IT and Computers, Information Systems or Computer Science
- Good knowledge of Linux operating systems is valued
Good shell scripting knowledge is valued - Knowledge of the objectives and terminology of distributed high-availability systems is valued
- Team player and problem-solving skills
- Good communication skills (written and spoken)
- Fluent English (written and spoken)
// Will be a nice plus if you have:
- Hands-on experience in setting up large scale Data Platforms
- Hands-on experience with Cloud Providers
- Curiosity about Big Data technologies such as Spark, Kafka, MongoDB
- Hands-on experience with automation tools such as Ansible, Terraform or CloudFormation
- Experience in Kubernetes and the various existing flavours Openshift, Rancher, AKS or EKS
// Learn more about Big Data area:
Cláudio Pereira, Platform Engineer
@Xpand IT
As a Big Data Platform Engineer, your days will be filled with new challenges, from designing, and monitoring infrastructures to building automation-compliant solutions tailored for the demands of this new era of information. You are not alone in the fast-evolving ecosystem that this sector provides and can count on working with a great team to also aid you.
