Contact Us
Big Data Software Engineer

Big Data

Software Engineer

Be an Xpander

Big Data Software Engineer

Complex problems require the right expertise! Today, one of the biggest challenges lies in data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on capturing, ingesting, storing and managing critical data from huge clusters where the 3Vs are always present. As concerns technology stack, we take advantage of almost every state-of-the-art framework in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming languages to interact with them.

YOUR ROLE

As a Big Data Software Engineer, you’ll play a key role in the team along with Big Data System Engineers to create the best software solutions, applying big data best practices in terms of architecture and systems design. You’ll ensure that backend software performance, reliability and scalability are achieved regardless of how fast data clusters grow or the throughput of information increases.

Your daily activities will include:

  • Implementing software solutions that include loading, pre-processing and ingestion from disparate data sets into big data clusters.
  • Designing robust and reliable software solutions regardless of the amount of input data.
  • Implementing big data industry standards into the end software solution
  • Analysing complex problems that need solutions for efficiently manipulating huge amounts of information
  • Developing data models and data organisations that optimise “search” and “store” operations in large-scale distributed systems
  • Designing APIs for swift data tracking and query data at high speeds

// Stacks: Java; Scala; HDFS, Hive, Impala, Spark, Kafka/Confluent; MongoDB, HBase

Oportunidades de Emprego Xpand IT
Oportunidades de Emprego Xpand IT
Oportunidades de Emprego Xpand IT
Oportunidades de Emprego Xpand IT
Oportunidade Emprego Big Data Software Engineer Hbase
Oportunidade Emprego Big Data Software Engineer Hive
Oportunidade Emprego Big Data Software Engineer Scala
SKILLS YOU NEED TO HAVE
  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Sound knowledge of Linux operating systems
  • Experience with Java-oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST/SOAP)
  • Experience with design patterns to implement advanced software solutions.
  • Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
  • Sound experience in using Eclipse, Maven, Jenkins, GIT, JIRAor equivalent tools
  • Sound communication skills (written and spoken)

// Will be a nice plus if you have:

  • Knowledge or experience with Apache Spark, Kafka or the Hadoop ecosystem
  • Team player and problem-solving skills

// Learn more about Big Data area:

SQL, MongoDB
80
100
Eclipse, Maven, Jenkins, GIT, JIRA
55
100
Java
80
100
XML, JSON, SOAP
55
100

Apply here

Big Data Software Engineer
André Pires, Big Data Software Engineer
@Xpand IT

A Big Data Software Engineer is challenged every day to build scalable and resilient data processing systems that are the groundwork for data-driven decisions.