Blog – Tantus Data

partitionby, repartition, shuffle, spark

Spark shuffle – Case #1

10 June 201824 September 2018 by

This is the first of a series of articles explaining the idea of how the shuffle operation works in Spark and how to use this knowledge in your daily job as a data engineer or data scientist. It will be a case-by-case explanation, so I will start with showing you a code example which does […]

Postgres, Sqoop

Sqoop and support for custom types

1 May 20171 March 2018 by

Marcin Szymaniuk

In this post you will become familiar with some more advanced Sqoop options. We will be discussing a very specific usecase of Postgres database and a schema containing UUID and WKB types. You might find them useful even if you are working with different database or some other data types.