In a big data world, data-driven decisions and Internet of Things, Analytics is often needed to acquire data insights. However, when data scientists forget to use visualizations to communicate or explore information they are missing out on a valuable tool.
Recently, one of our customers introduced an old-fashioned data solution: an error-prone ETL-flow coded in C to move flat files to Postgres. We wanted to demonstrate how this could be done with technologies such as Drill, Cassandra, Phoenix, Impala, ... The constraint we have to cope with is that the data ultimately should be consumable by Postgres using a Foreign Data Wrapper.
Piece of cake, right? Wrong!
I’m not telling you something new if I say the demands on IT from business are ever increasing. Certainly the last few years, business is looking more and more towards IT as a big part of the solution to their business problems.
The European Union has evolved over the past few years with regards to its energy policy, impacting the energy market and all energy players within it. These players have to face challenges, discover opportunities and continue to evolve within a competitive (unified) market.
In this article, we take a closer look at the challenges TSOs specifically have to tackle.