Diasoft Streamlined Data Lifecycle Management with the Hadoop Ecosystem
June 24, 2024
As technology advances at a faster pace, companies accumulate vast amounts of data. Data is the most valuable business asset: it is the basis for reporting, analysis of the company performance and the market, forecasting, managerial decisions and many other processes. Organized and secure data storage is essential for companies to comply with legal requirements and support their business operations.
To effectively organize large data volumes, companies need a robust data lifecycle management strategy. This ensures that current data remain available for operational needs, while the outdated information is securely archived. Importantly, archived data must be readily retrievable when needed.
To solve these tasks, Diasoft has implemented the data archiving functionality it its Digital Q.Reporting platform. The data archive can be built on the Hadoop ecosystem products.
The new data archiving functionality automates the following processes:
- Identification and transfer of data relating to archival periods from the main database to the cold data storage tier (it is used to store data that is rarely accessed by users).
- Setup of data storage policies.
- Checking the quality of data transferred to the archive.
- Deletion of data from the main database and from the archive in accordance with the data storage policy.
- Restoring data from the archive to the main database.
Efficient data lifecycle management, through organized archiving, offers companies several benefits, including reduced load on the main database and enhanced availability, integrity, and security of the archived data arrays. To ensure secure data storage, the solution manages access rights by user role, ensuring only the authorized users can view or interact with archived data.
The new functionality supports the ability to control and manage archiving tasks: approval, pausing, restarting and monitoring of the progress of archiving task, scheduling the autorun intervals, receiving email notifications upon creation and completion of new tasks.