What are the big data architecture layers?
- Big data sources layer: Big data arrives from internal and external sources, public and social media, business interactions and transactions, and increasingly from machines. The big data environment can ingest data by both batch processing or real-time processing.
- Data management and storage layer: This layer receives data from all the sources, converts it into a compatible format for the data analytics tools, and stores the data according to formats. It may use hybrid storage to efficiently manage the different formats.
- Analysis Layer: The analytics tools access the stored big data to extract business intelligence. Multiple tools may be used on structured and unstructured data, leveraging advanced technologies for predictive analytics and forecasting.
- Consumption Layer: This layer receives the analytical results and presents them to the relevant output layer for consumption, to humans, applications, or business processes.