NoETL. The little brother of NoSQL You have probably come across the term NoSQL. It was coined a few years back to describe a class of database systems that can scale across a large number of nodes for distributed (and sometimes global processing) of transactions (OLTP). Very early technologies were DynamoDB and Cassandra. These technologies trade in scalability for consistency … [Read more...] about JSON: To ETL or to NoETL? The Big Data Question
ETL
Data Supply Framework 3.0 ETL Patterns
This article is the first in a series of articles that discuss aspects of the use of architectural patterns in the Cambriano Information Supply Framework 3.0 The term architectural pattern may sound grand, misleading or daunting, but its really quite a simple concept. Its like writing a function in a programming language to log in to a database, check that the connection is … [Read more...] about Data Supply Framework 3.0 ETL Patterns
The Newcomers Guide to Data Warehouse Software
"Data warehouse" is a term that's been used in business intelligence since 1990. It refers to a collection of data that's kept separate from day-to-day operational data, such as transaction records, in order to provide a consistent historical dataset. For that reason, the information in a data warehouse must be unchanging and integrated as a cohesive structure that can be used … [Read more...] about The Newcomers Guide to Data Warehouse Software
How to Offload the ETL Bottleneck with Hadoop
Wheres my Data? There is a battle today inside IT to meet Enterprise Data Warehouse (EDW) overnight data load commitments with ETL solutions. Traditional ETL solutions have struggled to keep pace with the tsunami of data now being generated. Fortunately, there is a solution with an ecosystem of software called Hadoop. Before I stage the problem, I want to give you a reason … [Read more...] about How to Offload the ETL Bottleneck with Hadoop
How To Analyze a Large Amount Of Hadoop ETL Data
Building a hadoop ETL system is a challenging job as it is heavily constrained by unavoidable realities. The development team working on ETL system must live with data format of current system, clear business requirements and a clear idea of available legacy system. In this article, professionals will make you learn how to analyze the bulk ETL data with efficiency. You can … [Read more...] about How To Analyze a Large Amount Of Hadoop ETL Data