Category: Hadoop
-
Design Considerations for Building a DSS Data Pipeline
The complexity of a Decision Support System (DSS) varies widely between use cases. Sometimes the DSS will require data from one single, and independent source, such as streaming U.S. stock market Nasdq, or S&P500Â data. However, other DSS systems, which are the topic of this post, require data from multiple disparate data sources, such as exists…
-
Data Modeling in the Big Data Era: HDFS (Part 2)
From discussions that spun off from the last article on “Data Modeling in the Big Data Era,” it became apparent that a discussion of the Hadoop Distributed File System (HDFS) was warranted as this is basically the physical implementation of any Hive, or Impala model, and design considerations here also impact a few security concerns.…