You might be hearing a lot about Delta Lake nowadays. Yes, it is because of it's introduction of new features which was not there in Apache Spark earlier. Why is Delta Lake? If you check here, you can understand that Spark writes are not atomic and data consistency is not guaranteed. When metadata itself becomes big data it is difficult to manage data. If you have worked on … [Read more...] about Understand the fundamentals of Delta Lake Concept
data management
Data Lineage – How the History of Your Data can Influence the Future of Your Business
Almost every single industry has been revolutionized to at least some degree by data processing. Whether you manage a local restaurant or a massive distributorship, there's a good chance that you've recently made several decisions based on the availability of data that you previously lacked. Fewer people are paying attention to where their data is coming from, however. In fact, … [Read more...] about Data Lineage – How the History of Your Data can Influence the Future of Your Business
How Automating Your Invoice Processing helps You Grow Your Business
A technology and automation approach to invoice management frees up expensive F&A resources which can transition to higher value strategic activities. It strengthens vendor negotiating power, allows favorable payment terms, and improves cash flow visibility. An Office of Inspector General (OIG) audit showed the U.S. Environmental Protection Agency (EPA) risking close to … [Read more...] about How Automating Your Invoice Processing helps You Grow Your Business
Re-Slaving a Crashed MySQL Master Server in Semisynchronous Replication Setup
In a MySQL 5.7 master-slave setup that uses the default semisynchronous replication setting for rpl_semi_sync_master_wait_point, a crash of the master and failover to the slave is considered to be lossless. However, when the crashed master comes back, you may find that it has transactions that are not present in the current master (which was previously a slave). This behavior … [Read more...] about Re-Slaving a Crashed MySQL Master Server in Semisynchronous Replication Setup
Nordic Women and Data Summit 2019
Nordic Women and Data (NWD) Summit is envisioned as an annual event bringing together the community of women data practitioners to share ideas, discuss ways to harness the full potential of data and accelerate data- and AI-innovation across organisations. The event is scheduled for December 3rd at Vasa Theatre in Stockholm, Sweden. On stage, we are bringing some of the most … [Read more...] about Nordic Women and Data Summit 2019
