There is a more mature crawler scripting language than a framework. ForeSpider is a general crawler software, internal with a crawler script language. Many students learn PHP, but also self-taught Python, PHP understanding is relatively deep, why dodi technical personnel like to use Python to write crawlers?
Two, in fact, the complete visual acquisition does not require a computer professional. After roughly learning, you can start picking. And forespider does a good job of managing data. One is that the software can integrate databases and build tables before they are collected. Secondly, the data can be automatically weighted, which is especially suitable for financial industries with high data update requirements.
Third, about the problem of free, I think free things can also be good at the same time, only Chinese pirated software and mobile APP. Probably because people are used to paying nothing for software, they want to find something free.
Fourth, Python is only a scripting language. How can the collection efficiency and performance compare with the powerful C++? C++ directly controls the bottom layer of the system, and controls and saves memory space that other languages cannot compete with. First, forespider is developed in C++, and there are few existing frameworks for C++, while train collectors are developed in C#.