Big Data Expert
Division: BI Size of team: 6 Duties of the appointed resources will include: The main task as Big Data Expert is to do a whole lifecycle of big data product: i.e. analyze, solution design, development, deployment, documentation creation incl. model and further support.
The main languages we are using are Python, Scala, Bash, Python, and Spark jobs.
Also, you’ll come across Impala, Hive, Kafka, HBase, Zeppelin, Kerberos, and many others.
To define architecture patterns and user support incl. training and documentation maintenance is another part of the job.
The big data team consists of 6 people, mostly Big data Admins.
Our platform is mostly distributed by Hadoop by Cloudera. On top of that runs another 30 services.
Thanks to them we process it much faster and in bigger volume.
As we provide our services to 5 countries where Home Credit International a.s. operates, we need to be flexible and ready for change Knowledge of Python and Spark Experience with Hadoop, Hive, Impala, and Kafka (we use Cloudera distribution) Familiarity with Java and JVM Experience with SQL Experience with Scala (not mandatory) Understanding NoSQL databases such as HBase Knowledge of working with GIT and GitHub Agile/Scrum development cycle understanding