Speaking of the most popular languages of recent years, there must be Python. Why is Python so popular?

One of the main reasons for this is Python’s library richness — the Python language provides over 150,000 third-party libraries that are widely linked and packaged layer by layer. Covering almost all fields of information technology, here is a brief introduction to some third-party libraries commonly used in data analysis and visualization, WEB crawlers, automation, WEB development, and machine learning. With these libraries, we can’t stop building wheels.

I. Data analysis and visualization

It’s very useful for large companies to analyze the data and visualize it. Bar charts, pie charts, all of these can be generated from the library, just import the data.

1numpy

NumPy is the foundation of Python’s scientific computing toolkit. Many Python data computing working libraries rely on numPy, including statistics, linear algebra, matrix mathematics, financial operations, and more. Support a large number of dimensional array and matrix operations, in addition to array operations for a large number of mathematical libraries.

2pyecharts

Pyecharts is a library for generating Echarts diagrams.

3matplotlib

NumPy is the foundation of Python’s scientific computing toolkit. Many Python data computing working libraries rely on NumPy, including statistics, linear algebra, matrix mathematics, financial operations, and more. Support a large number of dimensional array and matrix operations, in addition to array operations for a large number of mathematical libraries. You’ll see him in a lot of places.

4plotly

Plotly is an open source, interactive, browser-based Python graphics library that supports scatter graphs, 3D graphs, and many more.

Second, web crawler

1Scrapy

Scrapy is an application framework designed to crawl site data and extract structured data. It can be used in a range of applications including data mining, information processing or storing historical data. This framework makes it easy to climb down data such as Amazon product information. This is a common one that many of you have heard.

2PySpider

Pyspider is a powerful web crawler system implemented by Python. It can write scripts on the browser interface, schedule functions and view the crawl results in real time, store the crawl results using common databases at the back end, and also set tasks and task priorities regularly.

1requests

Network request library, provides a variety of network request methods and can define complex send information, the HTTP protocol for high encapsulation, support very rich link access functions.

With the above library, you usually do crawler, and then crawl the data to do effective data analysis, that is much easier. If you want to learn the crawler can also pay attention to the public number: poetry like code, find me to learn together.