Summary: Cloud computing will change the database landscape

Recently, Li Feifei, head of Ali Cloud Intelligent database Division, delivered a keynote speech on “Database Industry in the era of new technological change” at a media conference.

Li Feifei said that cloud database has become the most important development direction of database, from the development of the international and domestic database industry, this trend has been very obvious. In his opinion, in the period of great changes in new technology, China’s database market will also undergo a series of significant changes.

As for the development strategy of Ali Cloud, he said that as the no.1 database vendor in China, Ali Cloud has been ready to fully serve the government and enterprise market, and will continue to make efforts in this market.

The following is the core of the speech:

The future of databases: cloud native + distributed

First, review the development of the whole database.

Over the past few decades, the scale of IT infrastructure has changed dramatically, from the early days of mainframes and minicomputers, to X86 servers, to the Internet, and then to the evolution of cloud +, where the number of underlying devices has grown exponentially from dozens to millions.

This change in infrastructure provides a solid foundation for the evolution of upper-layer databases. Just as species evolve in response to changes in their environment, as infrastructure — computing, storage, networking — evolves, so do database systems built on top of that infrastructure.

Different infrastructures correspond to different application scenarios and different historical stages of database development.

In the past few decades, database has experienced a development process from the early relational database, to the later data warehouse and relational database coordination, the segmentation of OLTP and OLAP, to the open source database, and then to the cloud database today.

Db-engines has an in-depth tracking analysis of the database space. Currently, there are nearly 400 different database products on the site, a number that illustrates how competitive the database market is.

Different types of databases are available on DB-Engines: relational, graph, document, and analytical, each tailored to a specific industry and customer niche. In addition to traditional commercial databases, databases in the open source community are growing rapidly.

Db-engines has an index, the Popularity Trend, which is calculated using a variety of metrics. The index shows that the gap in popularity between open source and commercial databases has narrowed rapidly.

All this shows that the database industry is undergoing new changes. Gartner notes several important trends in its report:

First, the scale of data has exploded. We are in an era of big data, no doubt.

Second, there is a growing need for real-time data production and processing. This is why Ali Cloud today proposed cloud native database 2.0 to provide one-stop data management and services.

Third, intelligent production and data processing. Now users no longer stay in the traditional transaction processing, transaction and simple or aggregate analysis query of data, but hope to get more insights from the data, using data to drive intelligent business decisions. This also poses new challenges to the subsequent development of our database.

Finally, the data is accelerating into the cloud. This is a very obvious industry trend. Although there are various forms of public cloud, hybrid cloud, private cloud and so on, all industries have been convinced of the deployment mode of cloud. According to Gartner, 75 percent of the world’s databases will be running in the cloud by 2023.

Database system architectures are also evolving rapidly. The earliest databases are single-node architectures, which are used by both traditional commercial and open source databases.

In practical application deployment, the advantages of this database are simple deployment and simple development. However, it also has disadvantages. First, it cannot provide high availability, active/standby operation and maintenance, and high availability switchover. It is very complex and faces great technical challenges. Second, rapid expansion is not possible. Like a small warehouse in your backyard, when the volume of data or concurrent processing requirements exceed the capacity, there is no way to quickly expand.

In order to solve the problems of elastic expansion and high availability, the industry has derived two core technology routes, one is cloud native technology route and the other is distributed database technology route.

What exactly is cloud native?

Cloud native is the nature of the resource pool, as families dig a well in the backyard, today won’t dig a well in the backyard, but will open faucet, on-demand volume use, flexible billing use of water resources, there is a large pool, this is called resource pooling, and cloud computing actually use computing storage network resources is the same reason.

The core concept of cloud native database is to use the essence of cloud computing and virtualization technology to pool the core resources in the database, so as to solve the challenges of resource elasticity and high availability. There is also a core concept of storage and computing separation, which decouples storage and computing to flexibly meet customers’ business needs.

In addition to cloud native, another technology direction is distributed.

In distributed mode, computing and storage can be horizontally expanded to meet the requirements of large data volume and high concurrency. Of course, there are challenges, distributed transaction processing, database still need to meet the characteristics of ACID atomicity, consistency, isolation, persistence, etc. Ensuring efficient processing of reads and writes is a challenge in a distributed architecture.

The future development trend of database must be the combination of cloud native capability and distributed capability, providing both distributed horizontal expansion capability and elastic high availability capability of cloud native. The combination of the two is also the direction of further exploration and development of aliyun’s cloud native database represented by PolarDB.

Cloud computing is changing the database landscape

Ali Cloud database in the cloud native field of continuous cultivation and accumulation for many years, we have made some progress. Gartner predicts that 75 percent of all databases will be running in the cloud by 2023.

Gartner does the Magic Quadrant every year to assess the key tracks in cloud COMPUTING IT. Prior to 2013, the database leadership quadrant was largely dominated by the traditional giants: Oracle, Microsoft, IBM’s DB2, and SAP.

By 2020, the market has undergone earth-shaking changes. An obvious feature in the overseas market is that in addition to the traditional database giants, AWS, Google, Microsoft and other cloud vendors have also entered the leadership quadrant.

It is worth mentioning that Microsoft is now and Microsoft in those days completely different, Microsoft entered the leadership quadrant is due to its cloud database service ability to improve quickly, very competitive. Combined with its offline database and cloud database strengths, Microsoft has achieved an overall market share overtaking Oracle.

Ali Cloud database entered the global database leader quadrant for the first time in 2020, which is also highly recognized by Gartner after in-depth evaluation of product maturity, technological advancement, customer satisfaction, market share and other dimensions.

Photo credit: Extra large

The chart above compares the latest global database market share rankings from 10 years ago to 2020. The global database market share list includes the market share of cloud database and traditional offline database. Oracle has always been the number one in the past. In 2020, Microsoft overtook Oracle for the first time.

This is actually Microsoft using SQL Server and Azure cloud database rapid growth, the combination of the two track to achieve the reverse over Oracle, this is a very historic milestone event, once again highlights the cloud database in the new environment, the importance of various vendors and database market.

In addition, in the past few years, Aliyun’s market share has continued to increase, and has reached the seventh place in the world. If we only look at the cloud database track, Ali Cloud ranks the fourth in the world, following AWS, Microsoft and Google.

Historic new opportunities for the database industry

Although database is a track that has been in development for four decades, it is not a conformist track. I think at this point in time, databases are still a very dynamic racetrack, with lots of new market opportunities and new flashpoints.

First, database is the first track of basic software. There are many basic software, but database is the most core category of basic software, and also a category with the largest market volume.

Second, from a developer’s point of view, more than half of developers use databases, which is important.

There are several new opportunities for the development of Database industry in China, which can be called four new — new policies, new faces, new technologies and new opportunities.

First, new policies. This is mainly because the state has issued a series of policies, the importance of basic software to an unprecedented height. The state encourages our Chinese enterprises to improve the competitiveness of domestic databases through open and fair market competition. From the perspective of technology level and market share, the state also provides a very good environment.

Second, new faces. Traditional last generation of domestic database manufacturers called the Four Dragons, derived to today’s domestic database track a hundred flowers bloom, there are more new faces, including cloud service manufacturers represented by Ali Cloud, as well as specializing in enterprise database software manufacturers.

Third, new technology. The reason we have this opportunity today to challenge the traditional database vendor market leader position and achieve the leapfrog is essentially the environment that we are in has changed dramatically.

As in Darwin’s Theory of evolution, rapid evolution takes place only when the environment around a species changes, and when a new species is able to adapt faster than the dominant old species, it evolves faster.

The emergence of new technologies, such as cloud native, distributed, intelligent, multi-module data processing for the Internet of Things, security and credibility, new hardware, and open source, these dimensions are today and in the future for a long time, each database manufacturer will launch fierce competition track.

Finally, new opportunities. More and more enterprise users will choose cloud deployment, which provides us with a very good opportunity to enter the traditional government and enterprise market.

Ali cloud database in public cloud market leader in not only, also be the comprehensive service for traditional offline enterprise market, in fact we have a lot of traditional enterprise services to our clients, and in the same way that a native of cloud, the cloud computing, for they brought before dividends enjoy less than traditional deployment way technology, not only from the IT cost reduction, ensure stable operation, It brings new business value and new business opportunities.

Cloud Native Database 2.0: One-stop data management

Review the development of Alibaba database:

During the period of rapid development of e-commerce from 2005 to 2009, Alibaba Group owned the largest Oracle cluster in Asia.

From 2010 to 2013, Alibaba successfully replaced the traditional commercial database with AliSQL.

In 2014, Alibaba started to lay out its own research database. Because business pushed us forward, for example, in the e-commerce shopping mall of Double Eleven, we saw the value of our own research database, so we firmly invested in the independent research and development of the basic software database.

From 2017 to today, through years of accumulated database technology, we provide rich database services, such as cloud database hosting service RDS, PolarDB and distributed version of cloud native database PolarDB-X, and AnalyticDB, cloud native data warehouse, These core products form our matrix of database products and services.

Through technology iteration, cloud native database 2.0 era, we hope to provide one-stop data management and services.

Ali Cloud database has come to the no. 1 position in The Chinese database market without dispute, and has the ability to compete and challenge to a higher level and higher market share on the global stage, and has entered the Gartner global database leader quadrant.

In addition, according to IDC’s latest China relational database market share research report, public cloud and offline combined statistics, Ali cloud database market share accounted for 28%, more than the second ten percentage points. In Forrester’s latest data warehouse report, Cloud native Data Warehouse AnalyticDB also entered the global strong leader quadrant, achieving multiple performance and cost-effectiveness results in the industry’s standard benchmarks.

We have not only made great breakthroughs and achievements in the commercial market, but also been highly recognized by the state. The core product of cloud native PolarDB, cloud native database was awarded the first prize of science and technology progress by the Chinese Institute of Electronics last year, which is the highest award of the Chinese Institute of Electronics. Our database is also the only selected database product, which reflects the recognition of our new technology and new scientific research strength from the national level and the perspective of scientific research.

AnalyticDB has also won the first prize of Zhejiang Provincial Science and Technology Progress. We have adapted a variety of hardware and operating systems such as x86 and ARM, so as to better serve China’s enterprise market and customers.

Looking into the future, I believe that cloud native database has developed to the market development stage mentioned by Gartner, and has begun to face the new demands of real-time data, integration of online transaction analysis and intelligent data processing.

Therefore, we propose cloud native database 2.0, which provides one-stop data management and service capabilities. Through data production and integration, real-time data processing and storage, data analysis and discovery, and finally data development and management, it provides whole-link data life cycle management.

On this basis, we provide customers with solutions for industry, which is geared to the needs of different customers and can produce the value of the industry solutions, the joint partnership with ecological service of our customers, from the distribution of ecological to the ISV is integration, to the ecological service, to the developer, to form a complete set of data link and ability of management and services.

Finally, I would like to thank our customers. Our customers are distributed in all walks of life, from pan-Internet industry to traditional government and enterprises, including transportation, energy, power, banking, insurance, securities and other industries.

We are very proud to create customer value through Ali Cloud database products and services, as well as continuous iterative innovation. By providing customers with high-quality database services, help customers achieve business progress and success, our customers to serve thousands of households, and ultimately contribute to the development of the whole society.

The original link

This article is the original content of Aliyun and shall not be reproduced without permission.