Over the past decade or so, DevOps has gradually matured. According to Google search statistics, the number of searches for DevOps tools has been increasing. DevOps covers the entire software development lifecycle, and as such, the toolchain ecosystem is rich. However, no single tool can cover all processes and be appropriate for all environments.
At present, the word “code farmer” has become a synonym for software engineer. Personally, I don’t like this word very much.
A good software engineer should be a problem finder, not a task taker.
If you want to successfully transition to a Problem Resolver, you need to understand the DevOps tool chain and master its usage.
Today, we’ll take a look at some of the most popular tools out there.
In a future article, we’ll show you how to build a small DevOps full tool chain at a cost of $0.
We benchmarked the software development lifecycle to see what popular tools are available at each stage. To better illustrate, break down each process.
Project Management (Plan)
This stage is Agile and the problem is how to plan the work well.
We mainly investigate document systems, project management systems, conference systems, instant messaging systems.
Documentation tool: Microsoft 365
Should be the most widely used document tool at present, with the demand of online document platform, Office is also gradually introduced to the cloud version.
Functions, we do not need to introduce, including Word, PowerPoint, Outlook, Excel and many other products.
- website
- The tutorial
Subscriptions are used. Includes home edition, business edition. Fees vary depending on the function, starting at $5. details
Documentation tools: Confluence
Confluence was developed by Australian company Atlassian and written in Java.
Launched March 25, 2004, Confluence is integrated as part of the Group software and can be used with JIRA or other Atlassian products including Bamboo, Clover,Crowd, Crucible, and Fisheye.
From personal experience, Confluence is one of the most useful corporate Wiki apps available today, and is used by many of the country’s largest companies. Offer privatized & SaaS versions.
- website
- The tutorial
| function | introduce |
|---|---|
| The knowledge base | A detailed description |
| collaboration | A detailed description |
| Shared | A detailed description |
Subscription-private is used. There are free editions, standard editions, premium editions, and enterprise editions. The fees vary depending on the function. Starting price: $5/ user. details
Documentation tool: Google Docs
Google Docs grew out of two separate products: Writely and XL2Web.
Writely is a text processor introduced by the software company Upstartle in August 2005. On March 9, 2006, Google announced its acquisition of Upstartle.
In March 2010, Google acquired DocVerse, an online document collaboration company. DocVerse’s product lets multiple users co-edit Microsoft Word, Microsoft Excel and Microsoft PowerPoint online.
In June 2012, Google acquired Quickoffice, a product that lets users edit Microsoft Word, Microsoft Excel and Microsoft PowerPoint on mobile devices.
In October 2012, Google Documents was renamed Google Docs[7].
Suitable for small overseas teams, not recommended for domestic use.
- website
- The tutorial
Documentation tool: Github Pages
GitHub Pages is a static Web hosting service that GitHub has offered to GitHub users since 2008 to host user blogs, project documents, and even entire books created as Pages.
Documentation suitable for open source projects, not recommended for internal use.
- website
- The tutorial
Documentation tool: PingCode
PingCode is an intelligent R&D management tool created by Worktile, an established SaaS vendor in China.
PingCode is affiliated to Beijing Yicheng Times Technology Co., LTD.
Domestic development of a long time an application, support SaaS & privatized version.
- website
- The tutorial
Subscription-private is used. There are free versions, team versions, enterprise versions, and private deployment versions. The fees vary depending on the function. Starting price ¥199 / user/year. details
Speed is a big advantage when used in China compared to overseas SaaS applications.
Documentation tool: Tower
Tower documentation tool from ONES.
A well developed company in China that supports SaaS & privatized version.
- website
- The tutorial
Subscription-private is used. There are free versions, team versions, enterprise versions, and private deployment versions. The fees vary depending on the function. Starting price ¥199 / user/year. details
Speed is a big advantage when used in China compared to overseas SaaS applications.
Document tool: Tencent document
Tencent document is an online document that can be edited by many people at the same time, supporting many types of online Word/Excel/PPT/PDF/ collection table/mind map/flow chart.
You can view and modify documents anytime and anywhere on computer (PC client, Tencent Document web version), mobile (Tencent Document App, Tencent Document wechat /QQ mini program), iPad (Tencent Document App) and other types of devices.
Open the web page can view and edit, cloud real-time saving, safe and controllable permissions.
Tencent’s online document platform. Recommended for small and medium-sized teams and open source projects. Currently free.
- website
- The tutorial
Project Management: Jira
Atlassian Australia. The name JIRA is not an abbreviation, but is taken from “Gojira”, the Japanese godzilla pronunciation.
The first version was released in 2002.
An old project management application with a large user base. Support SaaS version and private version.
- website
- The tutorial
The functions are very large, and we will not list them here. There are many online introductions and videos, so you can have a look at them. Not very suitable for small teams, because the features are too large for small teams to use.
Subscription-private is used. There are free editions, standard editions, premium editions, and enterprise editions. The fees vary depending on the function. Starting price: $7.50 / user/month. details
Project Management: Trello
Trello is a Web-based slate-viewing list-making app owned by Atlassian.
Originally founded by Fog Creek Software in 2011 and spun off as the basis of a separate company in 2014,
It was later sold to Atlassian in January 2017.
Trello is a project tracking/management application commonly used by overseas Internet companies. Mainly in the form of Kanban, more intuitive, suitable for various teams to use.
- website
- The tutorial
If the team wants to use Kanban mode, Trello is recommended.
Subscription-private is used. There are free editions, standard editions, premium editions, and enterprise editions. The fees vary depending on the function. Starting price: $5 / user/month. details
Project Management: Asana
Dustin Moskovitz left Facebook in 2008 to start Asana with Justin Rosenstein. At Facebook, they worked together to improve the productivity of their employees.
In April 2012, Asana opened up their APIS to third-party developers.
Anyone with an Asana account can use its application Programming Interface (API) for free through their developer website.
It’s so feature-rich that many big companies are using it.
- website
- The tutorial
Subscriptions are used. There are free editions, standard editions, premium editions, and commercial editions. The fees vary depending on the function. Starting price: $10.99 / user/month. details
Project management: ClickUp
Founded in 2017 with the United States, currently for the C round of financing, is a fast growing company.
The UI interface is simple and easy to use.
- website
- The tutorial
Subscriptions are used. There are free, standard, Business, Business Premium, and Enterprise editions. The fees vary depending on the function. Starting price: $5 / user/month. details
Project management: Monday.com
Launched in 2014 and July 2019, Monday.com raised $150 million based on a $1.9 billion valuation. The company went public in June 2021.
Feature rich, solid examples of the company.
- website
- The tutorial
Subscriptions are used. There are free editions, basic editions, standard editions, professional editions and enterprise editions. The fees vary depending on the function. Starting price: $8 / user/month. details
Project management: Domestic
Domestic project management products are also very many, we only list a few cloud manufacturers here.
| product | link |
|---|---|
| Ali cloud | Cloud effect |
| Tencent cloud | Coding Project Management |
| Tencent cloud | TAPD |
| Huawei cloud | Cloud Project Management |
| Gitee | Gitee |
im
The instant messaging platform is a key product that is essential to the [shared] corporate culture. However, enterprise-level im requirements are a bit more complex than the TO-C side and require integration with various DevOps systems.
We introduce some of the most popular enterprise-level im tools.
Most instant messaging products offer a wide range of free packages, which should be adequate for small and medium-sized teams. As for the selection, you can choose according to personal preference.
| product | describe |
|---|---|
| Slack | Slack is a cloud-based instant messaging software developed by Slack technology. It was officially launched in August 2013. |
| Microsoft Teams | Microsoft Teams is a communication and collaboration software that integrates chat, video conferencing, file storage (including file collaboration), Office 365, and more. |
| Chime | Is a communications service that lets you meet, chat, and make business calls inside and outside your organization, all using a single application. |
| Enterprise WeChat | Tencent enterprise instant messaging products. |
| nailing | Ali produces enterprise-level instant communication products. |
| Fly book | Bytedance’s enterprise-class instant messaging product. |
Meeting System
Before the epidemic spread, the conference system didn’t really get that much attention. Before the pandemic, large companies used Cisco WebEx for teleconferencing. Small companies use VOICE over IM.
With the increasing demand of telecommuting, the requirements of conference system are also very rich. This is also the reason why Tencent conference, Nail conference and other domestic products began to suddenly force last year.
Conference system: Zoom
Zoom was founded in 2011 by Yuan Zheng (A Chinese American), a former chief engineer from Cisco and its collaboration business unit, WebEx.
The Zoom service has been available since January 2013.
Zoom is currently one of the most influential brands of conferencing systems in the world, offering services as a SaaS.
- website
- The tutorial
In addition to video conferencing, it also provides instant recording, beauty, schedule and other supporting functions.
Subscriptions are used. There are free editions, professional editions, business editions, and enterprise editions. The fees vary depending on the function. Starting price is $14.99 / month details
Conference system: WebEx
Originally created in 1996 by Subrah Iyar and min zhu as ActiveTouch.
On March 15, 2007, Cisco Systems announced that it would acquire Webex for $3.2 billion.
WebEx is the oldest meeting system, so much so that before the pandemic, many large companies used WebEx, which shows its influence. We saw meeting equipment in the conference room, mostly WebEx products. As the pandemic has spread, WebEx has also aggressively promoted free services.
- website
- The tutorial
Subscription-private is used. There’s a free version, a starter version, a business version, and an enterprise version. The fees vary depending on the function. Starting price is $13.50 / month details
Conference system: Tencent Conference
Officially released in December 2019, there are currently Chinese version (Tencent Conference) and international version (VOOV).
During the pandemic, Tencent Conference played a very important role in remote collaborative working, and was free to use throughout the period.
- website
- The tutorial
Tencent Conference includes most of the functions that a conference system should have.
Subscription-private is used. There are personal edition, business edition, enterprise edition, Tencent conference Rooms. The fees vary depending on the function. Starting price is ¥399 / month details
Conference system: Nails nails
In May 2014, Dingding initiated the project within Alibaba. Dingding is an instant messaging system that includes meeting functions.
During the pandemic, nails were very important for telecommuting.
- website
- The tutorial
Nails contain most of the functionality expected of a meeting system.
Please refer to the official website for charging mode.
Conference system: flying books
Feishu, bytedance’s enterprise collaboration platform, deeply integrates instant communication, smart calendar, audio and video conferencing, OKR, Feishu documents and worktable. Through an open and compatible platform, members can achieve efficient communication and smooth collaboration at one place, and comprehensively improve enterprise efficiency.
There is a Chinese version (Lark) and an international version (LARK).
- website
- The tutorial
Flying books contain most of the features expected of a meeting system.
Please refer to the official website for charging mode.
Code
There are many more code-related tools, and here we discuss code repositories.
There are two main code repositories: SaaS and private. If you are a large company/team, you can consider using private. Even if it is private, it is recommended to deploy it in a cloud environment. Unless the code has high security requirements.
Personally, if it’s an open source project, small to medium sized teams, use GitHub & Gitee, large teams/companies, buy the private version of the repository. As for the brand, because it involves business communication, it can be decided according to the specific situation of communication, so there is no elaboration here.
SCM tool: Github
GitHub is recommended for open source projects or small team projects.
GitHub is a software source code hosting platform for Git version control. Written in Ruby on Rails by GitHub (formerly Logical Awesome) developers Chris Wanstrath, P. J. Hyett, and Tom Preston Warner.
Development of the GitHub platform began on October 1, 2007. The site was launched in beta in February 2008 and officially launched in April.
As of January 2020, GitHub has more than 40 million registered users and 190 million code libraries (including at least 28 million open source libraries), making it in fact the largest code repository and open source community in the world.
On the night of June 4, 2018, Us tech company Microsoft announced that it had acquired GitHub for $7.5 billion in stock.
Without a doubt, Github is the largest code hosting service in the world and the repository of choice for open source projects. At present, Open source China is also promoting Gitee for domestic open source projects. You can have a look at it.
- website
- The tutorial
| function | introduce |
|---|---|
| Collaborative development | Git has many features for collaborative development, including Code Review, Pull, Notification, and more.A detailed description |
| CI/CD | Supports CI/CD.The document |
| security | Enhanced code scan, dependency scan and other functions.A detailed description |
| monitoring | Monitoring of the code repository.A detailed description |
Subscriptions are used. Free edition, premium edition, ultimate edition. The fees vary depending on the function. details
SCM tool: Git
For large teams, you can use Git to build your own code repository in the cloud, but there is some operational overhead. Can buy privatized, after sale guarantee code warehouse, don’t spend energy on it.
Git is a distributed version control software originally created by Linus Torvalds and released as the GPL in 2005. It was originally designed to better manage Linux kernel development.
In 2005, Andrew Trigu wrote a simple program that connected to BitKeeper’s repository, and Larry McAvoy, the copyright owner of BitKeeper, decided to withdraw his license to use BitKeeper for free, believing that Andrew Trigu had reverse-engineered the protocols used inside BitKeeper.
The Linux kernel development team held discussions with BitMover, but were unable to resolve their differences.
Linus Torvalds decided to develop his own version control system to replace BitKeeper and wrote the first version of Git in ten days.
- website
- The tutorial
Note: Since GitHub can be operated via git CLI, GitHub also contains the following core functions.
| function | introduce |
|---|---|
| Open source | Free to use |
| Branch management | Through the concept of branch, the convenience of collaborative development is realized.details |
| Small and fast | Compared with SVN, Git’s performance is significantly superior.details |
| distributed | Distributed architecture improves system availability.details |
| Data security | Checksum is used to ensure data integrity.details |
| The collection area | Git add git commitdetails |
| The trademark | It is not possible to use Git trademarks directly, but GitHub, GitLab are allowed for historical reasons, but you cannot use trademarks like Git++.details |
Free, users can install and use their own.
SCM tool: GitLab
Support private deployment, SaaS version, recommended for small and medium teams.
In 2011, GitLab was developed by Ukrainian programmers Dmitriy Zaporozhets and Valery Sizov. It is written in Ruby. Later, part of it was rewritten in Go.
Initially, the product was named GitLab and was completely free and open source, distributed under an MIT license.
- website
- The tutorial
| function | introduce |
|---|---|
| Open source | Free to use |
| The project management | Similar to GitHub project Management.details |
| Small and fast | Compared with SVN, Git’s performance is significantly superior.details |
| distributed | Distributed architecture improves system availability.details |
| Data security | Checksum is used to ensure data integrity.details |
| The collection area | Git add git commitdetails |
| The trademark | It is not possible to use Git trademarks directly, but GitHub, GitLab are allowed for historical reasons, but you cannot use trademarks like Git++.details |
If teams want to build their own code hosting platform, GitLab is recommended.
SCM tool: Bitbucket
Support private deployment, SaaS version, recommended for small and medium teams.
Bitbucket started out as an independent startup.
On September 29, 2010, Bitbucket was acquired by venture capital firm Atlassian. Initially, Bitbucket only provided support for the Mercurial project.
Bitbucket officially announced support for Git hosting on October 3, 2011.
- website
- The tutorial
| function | introduce |
|---|---|
| Free private warehouse | An infinite number of seemingly existing warehouses. |
| CI/CD | Provides CI/CD functions.details |
| security | Code security scanning.details |
Subscriptions are used. Free edition, standard edition, premium edition. The fees vary depending on the function.
SCM tool: SVN
Old code version control system, not recommended, except for historical reasons, must be inherited.
CollabNet created the SVN project in 2000 to write a version control system that would operate in a similar way to CVS.
In November 2009, Subversion was accepted into the Apache Incubator project.
In January 2010, it officially became a top-level project of the Apache Software Foundation, free of charge.
- website
- The tutorial
SCM tool: Gitee
Open source China recommended code hosting platform. Recommended for small and medium-sized teams in China. If it is a large domestic team, you can consider the privatized version.
Gitee (Code Cloud) is a Git-based code hosting and collaborative development platform launched by Open Source China in 2013, providing Chinese localized code hosting services.
Gitee belongs to Shenzhen Aosi Network Technology Co., LTD.
- website
- The tutorial
| function | introduce |
|---|---|
| Code security hosting | Secure, stable and fast enterprise code management experience.details |
| Code review | Built-in Pull Request-based code review mechanism improves code access from the process.details |
| Project coordination | details |
Use SaaS subscription, private deployment. The fees vary depending on the function. details
SCM tools: Cloud vendors
In addition to the code hosting platforms mentioned above, every cloud vendor has code hosting services. Here we list the code hosting services of the big cloud vendors.
The advantage is that you can access code hosting directly through the cloud account, to achieve cloud native, support functions and professional code hosting platform is not very different.
If your team has a strong dependency on a cloud vendor, consider using code hosting on the cloud.
| Cloud vendors | link |
|---|---|
| AWS | AWS CodeCommit |
| Azure | Azure Repos |
| Cloud Source Repositories | |
| Ali cloud | Cloud code hosting |
| Tencent cloud | Worker bees |
| Tencent cloud | Coding code hosting |
| Huawei cloud | CodeHub |
Language framework
Frameworks are free, and it is recommended to use popular frameworks rather than niche ones. It’s not that niche is bad, but it’s hard to find information and answers online.
| language | The framework |
|---|---|
| Java | Spring |
| Golang | grpcSupport for multiple languages,gin |
| Python | django |
| PHP | Laravel |
| C/C++ | boost |
| JavaScript | react.nodejs |
| C# | ASP.NET |
| Scala | scala |
Build
We are talking about dependency management and build tools here, not continuous build. Code compilation is strongly bound to code types, so let’s look at dependency management tools for several popular languages. The compilation tools are free.
| language | tool |
|---|---|
| Java | Maven.Gradle |
| Golang | gomod |
| Python | python |
| PHP | composer |
| C/C++ | cmake |
| JavaScript | npm |
| C# | NuGet |
| Scala | sbt |
| general | Bazel |
Continuous Integration (CI)
Continuous integration is a software engineering process that continuously integrates all software engineers’ working copies of software into a shared mainline. The term was first suggested by Grady Booch in his distribution method.
In continuous integration, there are several important principles.
1: Maintain a code base
2: Automatic build
3: Make build time test itself
4: Everyone should submit once a day
5: Each submission shall be constructed
6: Test with a copy of the online environment
7: Make it easier to get the latest release
8: Anyone can view the result of the final build
9: Automatic deployment
As we mentioned in our previous post, an important part of DevOps is automation, and there’s no escaping CI.
With the growth of DevOps and the proliferation of continuous integration software applications, we introduce a few popular CI services.
CI tool: Jenkins
The oldest CI tool has a long history and a large ecosystem. The disadvantage is that it is older and more expensive to maintain. With the popularity of containers came Jenkins X, which is more suitable for the container environment.
Jenkins can be considered if the team does not already have containers, has historical baggage, or has no plans to do so in the near future, but I would recommend phasing out Jenkins use and maintenance.
Jenkins is an open source continuous integration tool written in Java. After a dispute with Oracle, the project was copied from the Hudson project.
Jenkins grew out of the Hudson (Software) project. Hudson was created by Sun Microsystems in the summer of 2004 and first released on Java.net in February 2005.
Around 2007, Hudson was known as a better choice than CruiseControl and other open source Build servers.
At the JavaOne conference in May 2008, Hudson was the winner of the Duke Choice Award for Developer Solutions category.
In November 2010, negotiations began between the project’s main contributors and Oracle over who would lead Hudson. Despite agreement on several fronts, the dispute centered on whether to register Hudson as a trademark. Oracle later claimed rights to the Hudson name and filed for trademark registration in December 2010.
On January 11, 2011, the community called for a vote to change the project name from “Hudson” to “Jenkins”. On January 29, 2011, the community voted overwhelmingly to approve the proposal to create the Jenkins project.
On February 1, 2011, Oracle stated that they intended to continue Hudson development and considered Jenkins to be a Hudson clone, not a Hudson renaming.
- website
- The tutorial
| function | introduce |
|---|---|
| free | |
| Continuous integration/deployment | This can be configured through the UI or.jenkinsfile.details |
| Simple and easy to install | Multiple installation modes can be deployed in a single machine, K8S, or multiple clusters.details |
| Configuration is simple | It’s a lot simpler than the code.details |
| The plugin is rich | Ecologically rich.details |
CI tool: CircleCI
CircleCI was founded in 2011 and is based in San Francisco, with employees working remotely from around the world.
At present, it has reached the F round of financing, ranking top in the FIELD of CI.
CircleCI is available as a free version of CircleCI. Many open source projects use CircleCI as a CI tool.
- website
- The tutorial
| function | introduce |
|---|---|
| Contains all the features needed for CI | details |
| Stability of SaaS services | details |
Subscriptions are used. There are free versions, performance versions, and extended versions. The fees vary depending on the function. The starting price is $15/ month. details
CI tool: Travis CI
Once an open source software, the core code is now closed source and available as a SaaS version.
A German company founded in 2011, it was acquired by Idera, Inc in 2019.
TravisCI is available for free. Many open source projects use TravisCI as a CI tool. If you are a GitHub open source project, use TravisCI.
- website
- The tutorial
| function | introduce |
|---|---|
| Contains all the features needed for CI | details |
Subscriptions are used. There are free versions, performance versions, and extended versions. The fees vary depending on the function. The starting price is $69/ month. details
CI tool: Bamboo
Provide a 30-day free trial, if you want to build CI system in your own cloud environment, it is recommended to use, good reputation.
A CI product from Atlassian, an Australian company. It is a purely private product.
- website
- The tutorial
| function | introduce |
|---|---|
| Contains all the features needed for CI | details |
A pure privatization programme was used, with a starting price of $1,200. details
CI tool: TeamCity
Jetbrains of the Czech Republic introduced CI in 2006. Jetbrains also produces ides known to us as Intellij, Goland and others.
SaaS version and privatized version are provided. If you want to build CI system in your own cloud environment, you are recommended to use it, and it has a good reputation.
- website
- The tutorial
| function | introduce |
|---|---|
| Contains all the features needed for CI | details |
A 14-day trial with a SaaS & Privatization program starts at $299. details
CI tool: Drone
An open source CI system. Acquired by Harness in 2020. It has been used by Cisco, ebay, CapitalOne, vmware and many other enterprises with a good reputation.
SaaS version and privatized version are provided. If you want to build CI system in your own cloud environment, you are recommended to use it, and it has a good reputation.
- website
- The tutorial
| function | introduce |
|---|---|
| Contains all the features needed for CI | details |
A 14-day trial with a SaaS & Privatization program starts at $299. details
CI tool: Tekton
An open source CI/CD application for cloud native, K8S native design, the first release in February 2019, is still in continuous iteration.
A CI/CD system running in K8S replaces the Job flow of traditional CI system with K8S Job. If you want to build a CI system by yourself, you are advised to use it.
- website
- The tutorial
| function | introduce |
|---|---|
| For cloud native, K8S native design | details |
| Open Source community active | details |
CI tools: domestic
In addition to several foreign CI systems mentioned above, there are also many similar manufacturers in China, including cloud manufacturers, who have withdrawn their CI applications one after another.
Domestic products are very many, we only list a few big manufacturers of products, you can search in Baidu. Continuous integration is a mature technology, so there is no drop-off.
However, because the domestic ecology is still poor, so if you buy, you need to judge according to the price, after-sales service and other conditions.
| product | link |
|---|---|
| Ali cloud | Cloud efficiency pipeline |
| Tencent cloud | Coding continuous integration |
| Huawei cloud | Assembly line |
| The volcano engine | Continuous integration |
| netease | Netease kites |
Test
Unit testing
We’d all love to have a tool that automatically generates unit tests, but we don’t have one yet. In fact, unit tests reflect the testability of the code, so the quality of the source code is related, and writing good unit tests is also one of the keys to writing good source code.
Let’s take a look at what unit testing class tools are available for different programming languages, and we’ve listed only the most popular frameworks.
| language | The test framework | Mock |
|---|---|---|
| Java | Junit | mockito |
| Golang | go | GoMock |
| Python | unittest | unittest.mock |
| PHP | PHPUnit | Mcck |
| C/C++ | Boot.Test | gmock |
| JavaScript | jest | jest.Mock |
| C# | C# UT | C# Mock |
| Scala | ScalaTest | ScalaMock |
The API test
With the spread of OpenAPI, API testing has become more standardized than before. Let’s list a few popular API testing tools.
| tool | introduce | Charging mode |
|---|---|---|
| Postman | The most popular API testing tool. | Free version & paid version |
| SoapUI | Open source Web API testing tools. | The free version |
| Apigee | Incorporated into the Google Cloud | Free version & paid version |
| Katalon Studio | Free test automation solution for apis, Web applications, desktop applications, and mobile applications. | Free version & paid version |
| Tricentis | Integrated test platform. | The premier edition |
Integrated test platform
In addition to the most basic unit testing and API testing tools, the industry offers a complete suite of testing platforms.
There are a variety of testing platforms, providing different testing solutions according to different businesses, such as CDN testing, pressure testing and so on.
We only list some popular test platforms here, if you want to find the corresponding test platform in China, the best way is to ask each major cloud platform, each cloud platform has testing services for sale.
| tool | introduce | Charging mode |
|---|---|---|
| Tricentis | Integrated test platform. | The premier edition |
| Neotys | API, mobile, pressure and other test solutions. | The premier edition |
| SmartBear | A variety of test schemes are provided. | The premier edition |
| Katalon Studio | Free test automation solution for apis, Web applications, desktop applications, and mobile applications. | Free version & paid version |
| Eggplant | A variety of test schemes are provided. | The premier edition |
Deploy
Deployment can be divided into three types.
- Process replacement: The most traditional method, usually used on physical machines, is to shut down the old process and start the new one.
- Volume replacement: for cloud hosts, an Artifact is packaged into a block storage and the VIRTUAL machine replaces the block storage.
- Container images: Update version with container images.
Artifact management tools
Artifacts are packages of compiled code. It can be any form of file, such as tar file, Docker image, etc.
Here we mainly introduce the Docker Registry platform, that is, the Docker repository. Of course, users can build their own through Distribution.
| tool | describe |
|---|---|
| DockerHub | Free, but limited streaming. |
| Quay | Free, RedHat container repository. |
| JFrog | Charging, the recent more popular platform, support a variety of formats warehouse and distribution. |
| Nexus | Professional Artifact management tools. |
In addition to the above platforms, each cloud vendor provides a container repository.
Continuous Deployment (CD) tool: Ansible
Probably the most widely used deployment tool of all time. You can also use the command line interface (CLI)AWXUI to operate.
Many teams currently use Ansible for cluster environment initialization.
An open source software.
Ansible was written by Michael DeHaan and acquired by Red Hat in 2015.
Ansible is agent-free and uses SSH or Windows Remote Management (allowing remote PowerShell execution) to make temporary remote connections to perform its tasks.
- website
- The tutorial
In theory Ansible can do just about anything. The most common uses are cluster environment initialization and process replacement deployment.
Continuous Deployment (CD) tool: Spinnaker
Have a good deployment open source application for K8S and cloud virtual machines. Developed by Netflix. It’s proven in the Netflix business.
If you want a commercial version of Spinnaker, consider itAmory
Spinnaker is a free open source continuous delivery software platform originally developed by Netflix and extended by Google.
Works with Kubernetes, Google Cloud Platform, AWS, Microsoft Azure, and Oracle Cloud.
- website
- The tutorial
If you want to use Spinnaker, the operation is a problem and requires a dedicated person to operate the operation, as well as a period of training due to the deployment pattern is not the same as the traditional [replacement process] method.
Continuous deployment (CD) tool: Tekton
An open source CI/CD application for cloud native, K8S native design, the first release in February 2019, is still in continuous iteration.
A CI/CD system running in K8S replaces the Job flow of the traditional CD system with K8S Job. You are advised to set up a CD system by yourself.
- website
- The tutorial
| function | introduce |
|---|---|
| For cloud native, K8S native design | details |
| Open Source community active | details |
Compared with Spinnaker, it is much lighter, but the disadvantage is that you need to write a Job YAML template, which requires a certain amount of K8S knowledge compared to Spinnaker’s UI operation.
Continuous Deployment (CD) tool: Chef App Delivery
A partially open source product produced in 2009, including server management, application deployment and other functions.
It has a good reputation in the commercial field, but not much information in the open source ecological field.
There is not much information in the field of open source ecology, so it is not recommended for small and medium-sized teams.
- website
- The tutorial
Continuous Deployment (CD) tool: Puppet
Puppet was founded in 2005 by Luke Kanies.
Using the core open source model, it is a holistic solution that incorporates multiple DevOps features.
It has a good reputation in the commercial field, but not much information in the open source ecological field.
There is not much information in the field of open source ecology, so it is not recommended for small and medium-sized teams.
- website
- The tutorial
Continuous Deployment (CD) tool: Jenkins
Jenkins can also be used as a CD service.
Continuous Deployment (CD) tool: Jenkins X
For cloud native, K8S research and development of an open source CI/CD products.
- website
- The tutorial
Continuous Deployment (CD) tool: Argo
Kubernetes is an open source CD tool based on GitOps.
- website
- The tutorial
Continuous deployment (CD) tool: Octopus Deploy
Support cloud native, a CD tool from Kubernetes.
- website
- The tutorial
Available by subscription and private, starting price: $50/ month. details
Operation and Maintenance
The ecosystem of operations is larger than any of the others, and here we focus on tools in the resource management space (IaC, Cloud, Kubernetes).
IaC tool: Terraform
The remote version was released in July 2014, produced by Hashicorp. IaC is a cross-cloud IaC tool that currently supports almost all popular cloud vendors.
Open source and free.
In the IaC space, Terraform is arguably the most popular. Recommended.
- website
- The tutorial
IaC tools: Ansible
Ansible can also be used as IaC tools.
- website
- The tutorial
IaC tools: Cloud vendors
| Cloud vendors | product |
|---|---|
| AWS | CloudFormation |
| Azure | Azure Resource Manager |
| Google Cloud | Deployment Manager |
| Ali cloud | Cloud speed by |
| Tencent cloud | TIC |
| Huawei cloud | Application Choreography Service |
Cloud vendor: AWS
The cloud computing platform created by Amazon provides individuals, enterprises and governments with a range of services including information technology infrastructure and applications, such as storage, database, computing, machine learning and so on.
In 2006, cloud products S3 and EC2 made their debut. AWS currently offers more than 175 service products.
AWS is undoubtedly the world’s largest cloud service vendor in terms of technology, market and influence. Outstanding in service stability and performance. AWS is recommended if the business has high requirements for the stability of underlying services or wants to use them overseas.
However, some services, such as CloudFont, are not available in China.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| EC2 | To calculate |
| S3 | storage |
| RDS | The database |
| CloudFront | CDN |
| Route 53 | DNS |
| Lambda | Unserved function |
Cloud vendor: Azure
Microsoft’s Public Cloud Service platform.
It has been developed since 2008 and officially launched in February 2010.
Azure currently competes with AWS in the global public cloud market very fiercely. In terms of data center, product type and scale, Azure is already comparable to AWS Qihoo.
Many domestic cloud vendors learn from AWS in terms of basic product types and interfaces, but Azure has its own characteristics.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| Virtual Machines | To calculate |
| Azure Blob Storage | storage |
| Azure SQL | The database |
| Content Delivery Network | CDN |
| Azure DNS | DNS |
| Azure Functions | Unserved function |
Cloud vendor: Google Cloud
Google’s cloud computing services,
In April 2008, Google released the App Engine, its first cloud computing service.
With Azure and AWS to compete for the share of the global cloud market, Google’s strong technical advantages, data center advantages, rapid development.
If you have overseas business, you can consider not providing domestic services.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| Compute Engine | To calculate |
| Cloud Storage | storage |
| Cloud SQL | The database |
| Cloud CDN | CDN |
| Google Kubernetes Engine | The container |
| App Engine | Unserved function |
Cloud vendor: Openshift
OpenShift is a PaaS cloud computing platform launched by Redhat. It was first introduced in 2011.
Openshift currently offers three products: Openshift Online, Openshift Enterprise and Openshift Origin.
Among them, OpenShift Online is an Online public cloud platform for ordinary developers and small and micro enterprises. OpenShift Enterprise is a private cloud platform for enterprises; OpenShift Origin is an open source project that forms the basis for the first two.
An open source cloud platform. Many companies will adapt Openshift to build their own cloud platforms, as well as commercialize Openshift.
If there is a need to build your own cloud platform, you can use Openshift, otherwise it is better not to build your own cloud platform, the operation and maintenance costs will be beyond imagination.
It is also possible to build Openshift on top of cloud services, such as Openshift on AWS, but only when there is a specific need.
- website
- The tutorial
Cloud vendor: Heroku
Heroku is a cloud platform service that supports multiple programming languages. It was acquired by Salesforce.com in 2010.
Instead of covering all cloud products like AWS, Heroku has built a more user-friendly product as a portal for specific scenarios.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| Heroku Platform | The container |
| Heroku Redis | The database |
| Heroku Postgres | The database |
| Apache Kafka on Heroku | The data flow |
Cloud vendor: Aliyun
Founded in September 2009, it is wholly owned by Alibaba Group.
By 2020, Ali Cloud ranks third in the global market share of public cloud IaaS vendors, next only to AWS and Azure.
China’s leading public cloud field, products and services, covering all areas of cloud computing. Domestic team, recommended use.
Offer domestic edition, international edition, privatized.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| ECS | To calculate |
| OSS | storage |
| Cloud SQL | The database |
| Cloud CDN | CDN |
| Google Kubernetes Engine | The container |
| App Engine | Unserved function |
Cloud vendor: Huawei Cloud
Huawei Cloud was founded in 2005 and belongs to Huawei.
It focuses on the technical research and ecological development of the public cloud in cloud computing, and is committed to providing users with one-stop cloud computing infrastructure services.
Huawei Cloud and Ali cloud currently compete in the domestic public cloud market is very fierce, whether in data center, product type, scale.
Offer domestic edition, international edition, privatized.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| ECS | To calculate |
| OBS | storage |
| RDS | The database |
| CDN | CDN |
| CCD | The container |
| FunctionGraph | Unserved function |
Cloud vendor: Tencent Cloud
In 2010, Tencent open Platform began to develop, and began to provide cloud server, CDN, database and other core products.
With Huawei cloud, Ali cloud together to compete for the share of the domestic cloud market, with strong technology accumulation, rapid development.
Offer domestic edition, international edition, privatized.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| CVM | To calculate |
| COS | storage |
| TencentDB | The database |
| CDN | CDN |
| EKS | The container |
| SCF | Unserved function |
Cloud vendor: Baidu Intelligent Cloud
Baidu Intelligent Cloud was officially opened to the public in 2015.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| BCC | To calculate |
| BOS | storage |
| RDS | The database |
| CDN | CDN |
| CCE | The container |
Cloud vendor: Ucloud
UCloud is a provider of basic cloud computing services, founded in March 2012.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| UHost | To calculate |
| US3 | storage |
| UDB | The database |
| UCDN | CDN |
| UK8S | The container |
Cloud manufacturer: Jinshan Cloud
Kingsoft cloud computing enterprise, founded in March 2012.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| KEC | To calculate |
| KS3 | storage |
| KRDS | The database |
| CDN | CDN |
| KCE | The container |
K8S Cluster management
According to most cloud manufacturers provide K8S service, the management of K8S can be operated directly in the cloud console.
In special cases, if you want to build your own K8S services, you can use some platform-level services.
| product | describe |
|---|---|
| minikube | Open source stand-alone K8S for test verification. |
| Rancher | Solves the operational and security challenges of managing multiple Kubernetes clusters across any infrastructure, |
| Spirit finches cloud | Kubernetes commercialization tool platform, provides one-click deployment of Kubernetes, while solving Kubernetes difficult to use and other problems. |
Evaluation
The evaluation stage includes three stages: [monitoring] [alarm] [analysis]. We will not go into details here.
The scope of [monitoring] is very broad, and there are a few that we need to look at. We’ll cover each area in more detail in a future article.
- APM: Application Performance Monitoring
- BAM: Business Activity Monitoring
- ITIM: IT Infrastructure Monitoring
- ITOM: IT Operation Monitoring
- ITSM: IT Service Monitoring
- NPMD: Network Performance Monitoring and Diagnostic
- SIEM: Security Information and Event Management.
With monitoring, you can realize alarm and analysis. Here we focus on BI tools in the analytics space.
Monitoring: Elastic
Elasticsearch is a Dutch company founded as Elasticsearch in Amsterdam, Netherlands in 2012.
Elastic is a search company that builds self-managed and SaaS products for search, logging, security, observability, and analytics use cases.
One of the most popular products dealing with logging, full link products from log collection, filtering, analysis, monitoring, search.
Many cloud vendors put Elastic on their official product pages, where they can be easily opened. However, using Elastic requires a certain amount of knowledge.
- website
- The tutorial
| On behalf of the product | Functional areas |
|---|---|
| Elasticsearch | Search engine |
| Kibana | Web UI |
| Beats | collect |
| Logstash | The filter |
Monitor: Prometheus + Grafana
Prometheus is a free software application for event monitoring and alerts. It began development on SoundCloud in 2012.
Grafana is a cross-platform, open source data visualization web application platform. Grafana was first released in 2014 by Torkel Odegaard as an offshoot of the Orbitz project.
One of the most popular open source monitoring solutions, code injection, some cloud vendors are adding Prometheus services to their official websites. Recommended.
- Prometheus’s official website
- Prometheus tutorial
- Grafana website
- Grafana tutorial
Monitor: Grafana Loki
Loki is a horizontally scalable, highly available, multi-tenant log aggregation system inspired by Prometheus.
Elastic is good at log collection and search, but it’s getting harder all the time. If you want a simple log collection + search product, recommend this one.
- website
- The tutorial
Monitoring: Splunk
Splunk is a SAN Francisco-based technology company whose products focus on machine-generated big data search, monitoring and analysis.
Its namesake products index and create associations for data from specified data sources, then generate charts, reports, warnings, and present them as graphical web pages.
Founded in 2003.
Logging, monitoring, APM, security, and other features are used by large enterprises, and Splunk has strategic partnerships with cloud vendors.
Suitable for large enterprises/teams, but a little expensive.
- website
- The tutorial
- The price
Monitoring: DataDog
Datadog is a cloud-specific monitoring service that provides monitoring of servers, databases, tools, and services through a Saas-based data analytics platform, led by ITIM.
Founded in 2010.
DataDog is very compatible and easy to use for overseas cloud vendors. You are advised to use AWS and other overseas cloud vendors.
- website
- The tutorial
- The price
Monitor: New Relic
New Relic is a SAN Francisco-based technology company that develops cloud-based software to help website and application owners track the performance of their services.
ITSM as the main products. Founded in 2008.
A comprehensive monitoring type product, including ITIM, ITOM, ITSM, SIEM, NPMD and other fields of products. Recommended for large teams with overseas business.
- website
- The tutorial
- The price
Free edition, standard edition, professional edition, enterprise edition.
Monitoring: cloud vendors
With the exception of SaaS vendors, every cloud vendor provides monitoring services, which we list.
| Cloud vendors | product |
|---|---|
| AWS | CloudWatch |
| Azure | Monitor |
| Google Cloud | Cloud Monitoring |
| Ali cloud | The cloud monitoring |
| Huawei cloud | CES |
| Tencent cloud | CM |
Warning: Pagerduty
PagerDuty is a US cloud computing company specializing in SaaS event response platforms for IT departments.
Founded in 2009.
An established alarm SaaS service, compatibility with the monitoring ecosystem is very good.
- website
- The tutorial
- The price
Free edition, professional edition, business edition, enterprise edition.
Alarm: Others
In addition to professional alarm services, IM tools such as wechat, enterprise wechat, Dingding.com and Feishu also include alarm interfaces.
Therefore, if small and medium-sized teams have no special requirements, they do not need to purchase an alarm service. Instead, they can configure the IM tool on the monitoring platform.
We’ll cover a few best practices in a future article.
BI tool: Salesforce
Salesforce, headquartered in San Francisco, California, is an Internet company that provides customized customer relationship management planning and services.
Salesforce was founded in 1999 by Marc Benioff, a 37-year-old Russian-American senior vice president at Oracle (ORCL).
One of the biggest companies in the SaaS industry now offers BI tools (Tableau) and many other products.
- website
- The tutorial
- The price
BI tool: SAP
SAP is a German software company, headquartered in Waldorf, Baden-Wurttemberg, Germany, specializing in enterprise resource management software.
Founded in Germany in 1972.
Established enterprise software provider, currently used by many companies and public utilities. In addition to providing BI tools, there are many other areas of products.
- website
- The tutorial
BI tools: Microsoft Power BI
Power BI is a business analysis service from Microsoft.
It is designed to provide interactive visualization and business intelligence capabilities with an interface simple enough for end users to create their own reports and dashboards. Is part of the Microsoft Power Platform.
Released in 2011.
BI tools provided by Microsoft have good compatibility with Azure cloud.
- website
- The tutorial
- The price
BI tools: Google Data Studio
An online tool for turning data into customizable information reports and dashboards launched by Google on March 15, 2016, as part of the Enterprise Google Analytics 360 suite.
In May 2016, Google announced a free version of Data Studio for individuals and small teams.
Google Data Studio is part of the Google Marketing Platform.
- website
- The tutorial
BI tool: Amazon QuickSight
AWS offers cloud-oriented, scalable, serverless, embeddable, machine learning-driven BI services.
- website
- The tutorial
- The price
BI tool: Alibaba Cloud Quick BI
Quick BI — BI product used by all customers on Ali Cloud (the only BI selected by Gartner ABI magic Quadrant in China).
Seamless connection with all kinds of cloud databases and self-built databases, greatly improving the efficiency of data analysis and report development, 0 code mouse-drag operation interaction, so that business personnel can easily realize massive data visualization analysis.
- website
- The tutorial
- The price
BI tool: Huawei FusionInsight
Huawei cloud FusionInsight intelligent data Lake provides enterprise-level data lake solutions for more than 3,000 government, financial, carrier, and large enterprise customers in more than 60 countries and regions around the world.
- website
BI tool: Tencent Cloud BI
Business Intelligence (BI) is a new-generation agile self-service BI service platform that supports self-service data preparation, exploratory analysis, and enterprise-level management and control.
In just a few minutes, you can easily complete a series of data visualization operations such as data analysis, business data exploration and report making in the cloud.
Convenient drag-and-drop interaction allows you to quickly understand the correlation, trend and logic behind data without relying on IT personnel or worrying about trial and error costs.
- website
- The tutorial
- The price