About the author:
Pan Juan, senior DBA of JD Finance, is mainly responsible for the operation and maintenance of jd Finance’s production database and the development of database platform and middleware. Participated in the escort work of jingdong Finance promotion activities on June 18 and November 11 for many times. Responsible for the design and development project of JINGdong Financial database automation platform, now focus on the development of Sharding-Sphere distributed database middleware. Willing to learn and explore in database, automation, distribution, middleware and other related fields.
11 Beijing autumn crisp, sitting on the subway to write these stories, is willing to resonate with you, and I summed up, continue to fight.
From the DBA
An opportunity to
To be honest, I never knew what I wanted to do. Therefore, graduate students near graduation, numb dissociation in the interview of major companies. Thanks for meeting Qirong (Liu Qirong, now deputy director of JD Finance Operation and Maintenance), who started my journey as a DBA. Qirong boss is a high eq, down-to-earth boss. It is the first time for me to meet an interviewer who talks about life problems in an interview and asks me to listen to his lecture without telling the interview result. When he talked about the world of databases and DBAs, and the free and vibrant atmosphere of Internet communication, I realized that some people are different and some places are where their hearts go.
daily
The work of a DBA is rigorous, fun, and hard work. As a young girl, she suddenly broke into a new database world and landed on a platform like JINGdong. The so-called database technology, business architecture, systematic vision and the vision of the Internet came rushing forward like a mountain shout tsunami, which made her feel powerless. However, in order to be responsible for my choice, and in return for everyone’s trust in me, I began to absorb the ocean of knowledge like a sponge and constantly improve my own cognition. For a whole year, I hid myself in the company’s empty conference room on weekends and devoured “MySQL Technology Insider: InnoDB Storage Engine”, “High-performance MySQL”, working notes and Shell programming techniques to develop my database knowledge and operation and maintenance skills. Because I know that when a person does not have enough strength, only time and efforts can make her change and gain the respect of others.
As the only girl in the group, thank them for treating me like a man, not an animal. Try not to give me a lot of night ops. But I really think that only these real jobs can see the real battlefield, and only such battlefield can make soldiers grow up quickly. So I threw myself into this endless battle, saw the moon at 3 in the morning, and cried about the endless torture and helplessness of moving all night. And the first error led to the user received garbled SMS, was complained caused by P1 level (maximum P0) failure, also finally know what is called by the leader. A person remorse in the winter huilongguan street wail, at a loss, anxious to smoke their two mouths! Now, that scene looks a lot like the classic movie scene where a girl gets dumped by her boyfriend. However, the remorse that hurt to the bone really made me feel the importance of the production environment and the extremely rigorous work of THE DBA. Behind a command I input are millions of data closely related to the business and the use and experience of countless users. Well, it’s the KPI that I dump on my boss and my comrades in arms in the whole department. I am grateful to the south wall that made me head broken and bleeding again and again, because it let me know the depth and scale of doing things, let me have the courage and strength to face greater challenges.
conclusion
This period of time makes me grow into a qualified DBA. In addition to mastering database knowledge system and surrounding ecology, I also accumulated experience in large-scale database operation and maintenance. In addition, the so-called risk awareness, fast and precise and rough operation and maintenance awareness also began to slowly establish. But I think there are two abilities that are very important, that is, the absolute execution of orders from superiors as a subordinate, and the ability to fight in a harsh environment.
Bearing in the conversation
An opportunity to
Human operation and maintenance and script operation and maintenance have been unable to meet the surging business development, and the database operation and maintenance requirements appear diversified and multi-dimensional requirements. At the same time, the marginal benefits of operations became more and more obvious, so the entire operations department began to shift to DevOps. At that time, the senior who was in charge of the automatic platform construction of the database work order system was suddenly seconded, so the project basically stopped. At that time, the devil in my heart wanted me to take the initiative to take charge of the project, but I didn’t have much experience in project development at that time. However, according to the development direction of the department at that time, automation is the general trend, only with the trend, in order to have the opportunity to obtain everyone’s recognition and affirmation, if the initiative at this time, it is possible to seek the machine in danger. After further analysis, I found that the large-scale database operation and maintenance experience I had accumulated in the early stage would enable me to understand the core needs and expectations of this project, and the communication foundation I had with colleagues in R&D and operation and the unique communication advantages of girls would further promote the project promotion. Then get huan elder brother (Zhou Huan, now network link database person in charge) after encouragement and authorization, begin! As the saying goes, not all games allow you to be fully prepared. In the face of crisis, sometimes try to take a leap of faith, may bring hope and change.
daily
Without experience in Python, I would devour Python development, and switch jobs to the group next to the Python god, so that I could consult at any time. Most of the time is basically in closed development state, the implementation of small iterative agile development policy. Analyze requirements, design plans, and code on the subway. Clarify requirements, develop features and solve bugs with boss in company. Weekend to take advantage of business trough, on-line test. In addition, cross-departmental cooperation and promotion. In the beginning, it was hard to make progress with work. Because people don’t listen to what you have to say, let you worry, anger, all of it doesn’t help. The more you try to convince the other person, the more you get an escalation of the argument. Then I realized, don’t try to argue with others about right and wrong, because there is no right and wrong. How to achieve mutual win-win and mutual satisfaction through negotiation and compromise is the king’s way. At the same time, Qirong brother told me the three spirit of the Internet: no money, no shame, no life, I think it is very reasonable. After a lot of communication and face-slapping, trust is gradually built. Respect you, respect your efforts, respect your ability, respect the interests of both sides. Finally, the average execution efficiency of database work orders increased by 70%, the interception rate of illegal work orders was 30%, and the correct execution rate of work orders remained at 99.99%.
conclusion
At this stage, according to the direction of the department, I changed from operation and maintenance DBA to database operation and maintenance development DBA, accumulated experience in project development, and laid a foundation for the subsequent change of profession without knowing what was going on. In addition, cross-department communication, cooperation and promotion also made me know how to choose and measure, win-win and cooperation, and keep an optimistic and peaceful attitude.
Turn on JAVA
An opportunity to
Database automatic chemical single platform has replaced the operation of human manual work, the development tends to be stable, at the same time feel their own circle and vision is too narrow. In such troubled waters, Boss Qirong introduced a new male god to me: Zhang Liang, the former head of Dangdang’s architecture department, who loves open source and joined JINGdong Finance with the dream of building Sharding-Sphere into a first-class finance-level open source distributed database middleware in the industry. Perhaps considering my DBA knowledge accumulation and postgraduate English level, of course, the most important thing is that I am shameless and kind. Therefore, let me assist Brother Liang in translating sharding-Sphere official files into English. Open source, database middleware, microservices, distributed transactions, database governance… A flood of fresh nouns rushed into my impoverished brain, opened a window on the wider world, and had a powerful attraction for me. In addition, the smooth growth curve made me eager to unlock the shackles of my narrow vision. Therefore, I began to analyze the current situation carefully: open source, distributed, microservices, Java development and other fields are new to me, and changing my career may abandon part of the accumulated accumulation of database industry. However, this database operation experience is a complementary advantage for a team that is all Java development and architecture. At the same time, the early database automatic chemical single platform project can also help me to make a smooth transition across the line. At this time, I finally discussed life and emotional problems with Qirong, and turned to the development of financial open source distributed database middleware, Sharding-Sphere.
daily
The translation of official documents in the early stage gave me a comprehensive theoretical understanding of the core functions and product positioning of Sharding-Sphere. So I started working at the source level, fixing small bugs, writing test cases, and eventually being responsible for a whole chunk of kernel functionality. Under the guidance of Brother Liang, I went deeper into the Sharding-sphere and gained a new understanding of coding. It’s definitely not about sitting back and writing whatever you want, but about the simple, elegant way of coding rules and logic and the value of refactoring iterations. The blank lines between functions, the number of Spaces at the beginning of paragraphs, and the naming of variables, which are unimportant things in the eyes of ordinary people, will be paid special attention to by Liang Brother. His 120% requirements for design and code make me pay 100% attention to details. The GitHub submission record shows the pace of change, from small incremental improvements to late module development (see figure below). Sitting on the workstation, seemingly in a daze, thinking and designing, logical sorting. Gain a deep understanding of the whole set of business logic, then feel fully happy; Through DBA vision and Liango’s communication of needs, new Revelations and ideas were gained, which felt quite meaningful; More often, a person enters the so-called “flow”, sketching out the architecture in his mind and gradually implementing it with code. That kind of forgetting about the surroundings and indulging in the code and music world makes people feel that time flies. When you really want to do one thing and are interested in it, you will know what is never tired of it.
In addition, it has also gradually stepped forward to share with the outside world and build its influence. By knowing Danniu, I also broaden my horizon and cultivate the sensitivity of the industry. The sharing of JD online platform expands the internal influence of Sharding-Sphere; Participated in the exchange and sharing of Huobi, Ele. me and Shell Gold to understand everyone’s understanding and demand for database middleware; Served as the host of 2018 ODF Database Conference, and re-saw the development of database industry; As the host of the ServiceComb event, I can feel the power of open source. Each activity experience is also a small accumulation, gradually let me understand the value of sharing, and build external influence. Thank you for your help, and thank Mr. Qirong and Brother Liang for sharing and communicating with us again and again. In fact, everyone has their own unique advantages, a lot of analysis and summary, according to local conditions, reasonable use, it is possible to make further progress.
conclusion
In this stage, we will hone our development skills and learn architecture reconstruction, and understand the architecture system of open source, distributed and middleware. Actively communicate and share with the outside world, cultivate the influence of the industry, exercise the ability of expression. Free control of time and extreme demands on things.
Suitable for?
At present, we still need to continue to accumulate the width and depth of the industry. Focus on DataBase middleware, DataBase Mesh, and open source. Under the leadership of Brother Liang, the Sharding-Sphere achieves the ideal height (P. Welcome to https://github.com/sharding-sphere! . At the same time, I also hope that I can think more, sharpen my character more, control the direction of progress, clear goals. However, the reality is very backbone, SHALLOW I am still exploring. For the future, if your height is not enough to support your current choice, it is better to learn from the thinking of Daniel and predecessors, who stand at that height may give you a new skylight.
To sum up the reasons for my growth, I think there are three main points. First, I would like to thank all the bosses I mentioned above for giving me the opportunity, giving me the authority to do things, and tolerating my arrogance and prejudice. Secondly, I would like to thank the big platform of JINGdong, which enables me to get to know these outstanding seniors, enables me to see the constantly changing and progressive world, and urges me to improve myself. Third, it is to thank themselves, know how to think and timely in accordance with the direction of development adjustment, only to go all out, go for it.
How far and how high will I go in this field, what kind of life will I have, what kind of stories will I write, and who will I be with along the way? For the future, now I also have no answer. However, the step by step solid exploration did make me stronger will and courage to face the reality that I have to face. May this little story along the way give you some thoughts and ideas that you are reading, and arouse your resonance. If so, also do not waste this eleven holiday code word and modification, also do not waste the right army teacher’s invitation. I believe that everyone has their own story and everyone is unique to you!