The field of data warehousing has different database types.
There are three different types that we are going to discuss here, although they are not the only databases available.
The first two types of database types are the traditional, which is also referred to as the OLTP (On Line Transaction Processing) and the document or virtual database.
1. OLTP (On Line Transaction Processing)
Traditional OLTP is a database management system that is designed to be a structured way to store your data, allowing multiple users to share and manage a database.
OLTP processing is one in which the system responds immediately to user requests. An automated teller machine (ATM) for a bank is an example of a commercial transaction processing application.
The primary goal of this type of application is to allow for quick search by a particular input.
Here is a good video describing OLTP:
2. The Document Database
The Document Database type does not support quick search methods.
It can be considered a “NoSQL” database, and can use JSON to interact with it.
This type of database is typically used in conjunction with Oracle and MS SQL Server to improve performance. The documents will often contain only one row of information, but many users will find the ability to access many different documents, and in some cases, also many users, useful.
Here is a video which gives more information regarding document databases:
3. The Data Warehouse
The Data Warehouse is a main database consisting of of the data from various OLTP database systems that can give out the data in bulk.
This is “Big Data”, and is used to analyze the big picture and trends.
The Data Warehouse can have the same capabilities as a traditional database. The Data Warehouse type was developed for large data sets that cannot fit into traditional database structures.
The data can be extracted from the source file into the data warehouse database (de-normalized).
In this case, an intelligent query is performed on the data warehouse. The result of the query is a dictionary of all the key-value pairs that pertain to the data set.
This type of application is usually used for large data sets where retrieval of data can take a long time. The other application that this type of database is used for is for the evaluation of strategies.
Here is a great video describing the Data Warehouse:
Many companies have not been able to come up with a common practice for how to organize the files. They normally use a “hodge podge” of systems, like Hyperion or SAP, and Excel and Access.
They seem to be sold on the various information being sold to them, and then after they purchase it, they figure out they need something else.
In my opinion, they should have a reliable person on their staff that they can consult with these data decisions. Great leaders did this in the past, they would consult with an individual specifically in that field of expertise.
Each organization has their own ways of getting their data from the document to the files, which is also fine, however, the results can be very fragmented and unorganized. Sometimes it is necessary to use more than one file system to gain access to all the files.
One company I contracted for used SAP as a big store for all their data, and then used MS Access to break it down into more understandable (digestible) parts, where decision making reports could be generated.
Let me know if you have any questions.