Big Data and NoSQL: Analyzing Complex Application Portfolios

by

There is more data to manage today than ever before, and this is creating an increasingly pounding headache for business executives that no dose of aspirin will soon relieve. With so many different forms of data and ways of storing that information within the organization, new data management methodologies are needed to make sense of this mind-numbing flood also known as Big Data.

Enter NoSQL. Differing from its much older and experienced brother – SQL – NoSQL has come onto the scene as the “new” and “hip” database paradigm (much like we talk about the Millennial generation). Also known as “Not Only SQL”, NoSQL is a flexible approach to data management and design that is useful for very large sets of distributed, unstructured data.

SQL is known for its ability to quickly query very structured, small sets of data, and it does so quite effectively. But with growing enterprise complexity and new forms of data emerging from things like connected devices and the Internet of Things, has given rise to NoSQL, which is less relevant for “small” structured datasets that are heavily transactional. NoSQL shines when handling big datasets that are queried frequently, in many different ways, requiring fast results. For this reason, NoSQL has become more popular when trying to analyze complex application portfolios and evaluate the structural soundness of software applications within complex ecosystems.

NoSQL encompasses a new family of database models that are not based on the original model by Edgar F. Codd, which was eventually named SEQUEL – then SQL – by IBM and Oracle. NoSQL is unique because it can easily manage a large number of server resources elastically using scale-out, rather than scale-up. The danger of NoSQL, however, is that it can diminish relational database skills because it is a framework that automatically manages itself.

Overall, NoSQL engines are specialized to ensure either consistency or high availability in distributed architecture. NoSQL engines are segmented to take advantage of this feature, rejecting historical “table” SQL databases. Instead, NoSQL agrees well with the unstructured system of Big Data. This is usually done by following five structuring models depicted below:

CAST expects to see more business applications using the NoSQL data architecture

While still fairly new to the scene (standard best practices for NoSQL have yet to be established), CAST expects to see more business applications using the NoSQL data architecture, and we have started consulting some of our customers in this regard.

Effectively and correctly managing enterprise data is extremely important to an application’s robustness and security. Poor data management can often result in data corruption that leads to software glitches and widespread outages, taking business operations down for days.

As applications that use NoSQL become more core to the business, their structural quality must also be closely monitored and measured.

To conclude, here’s what the archetypical MapReduce function would look like if it were written in SQL:

archetypical MapReduce function

 

Tagged:
Get the Pulse Newsletter  Sign up for the latest Software Intelligence news Subscribe Now <>
Open source is part of almost every software capability we use today. At the  very least libraries, frameworks or databases that get used in mission critical  IT systems. In some cases entire systems being build on top of open source  foundations. Since we have been benchmarking IT software for years, we thought  we would set our sights on some of the most commonly used open source software  (OSS) projects. Software Intelligence Report <> Papers
In our 29-criteria evaluation of the static application security testing (SAST)  market, we identified the 10 most significant vendors — CAST, CA Veracode,  Checkmarx, IBM, Micro Focus, Parasoft, Rogue Wave Software, SiteLock,  SonarSource, and Synopsys — and researched, analyzed, and scored them. This  report shows how each measures up and helps security professionals make the  right choice. Forrester Wave: Static Application Security Testing, Q4 2017  Analyst Paper
This study by CAST reveals potential reasons for poor software quality that  puts businesses at risk, including clashes with management and little  understanding of system architecture. What Motivates Today’s Top Performing  Developers Survey
Guillaume Diamant
Guillaume Diamant Consultant en infrastructure bases de données, Architecte IT
Load more reviews
Thank you for the review! Your review must be approved first
Rating
New code

You've already submitted a review for this item

|