keynote

The keynote section is in the morning, with a total length of two hours. Captain Cook began by saying, “Today is all about software.” So, this is a pure software upgrade demo.

Let me pick some points that are impressive and tell you about them.

  1. ARkit2, it looks like a pretty awesome upgrade, and you can see some of that from the measure app and the lego game demo. The lego game is particularly awesome, and the effects and interactions leave a lot of room for imagination. To make AR more usable and available in more scenarios, Apple also worked with Pixar to develop a new Model data format and support convertibility with common formats such as.obj. Many popular modeling software will also support this format.
  2. IOS12 has a few more powerful applications, I think the strongest should be integrated Workflow. Workflow has won apple’s Creative Design Award and is loved by users, especially developers. Apple acquired Workflow and now integrates it into iOS and seamlessly integrates with Siri to provide a great workflow customization experience that can be used to improve your daily productivity.
  3. Added several new Animoji, and there’s also support for your own fully-defined Memoji, which is kind of like the face-pinking system found in many games, but has a lot of action for the face, and Apple should be doing a lot of work at the software level to make this happen. Animoji can also be combined with face recognition, and is used in imessage and FaceTime. It works great when you capture a face in real time and replace it with an Animoji. Can be said to be a very innovative design and implementation.
  4. Facetime supports up to 32 simultaneous videos, and many of the details are very user-friendly and clever. This idea is not original, and wechat has long supported it, but the experience and details of this product are very important. Apple is a follower in many places, but in the end, it achieves the ultimate experience. For video calls, effectiveness is all that matters. It looks pretty good from the demo.
  5. Apple TV has been updated with a new dolby sound effect, which will make the live experience more explosive, and improved source quality. It also simplifies one validation step. The most important is the introduction of the little sister appearance level and voice are circle powder, here is not the picture, you can go to see the video.
  6. WatchOS5 was released, adding some functionality (such as holding down to speak).
  7. IOS12 will work on all devices, as long as your machine is running iOS11. So it’s a good thing for old users, and it’s an overall performance boost. My iphone6 has been upgraded as soon as possible, and most of the apps run without problems, and the performance has been improved to some extent. According to Apple, the performance optimization is mainly due to machine learning technology, which uses CPU time more efficiently and intelligently.
  8. Machine Learning has been greatly enhanced with new tools to help us model directly on the MAC, using swift. Without having to generate the transformation from a tool such as TensorFlow first. Some new ML-related apis have also been introduced.

In the end, the short video for the developers really caught my eye, and at that moment, I was in tears.

This section describes the Platform State Union

This is the afternoon, and it’s probably more important to developers than keynote. Since all of the presentations are basically accompanied by code and demos, it’s easy for developers to understand the meaning and value of the presentation, and all sessions over the next few days are explained, so you can choose from them.

From the above diagram, it is divided into 5 parts: Xcode10, Swift4.2, New ML, Metal, Arkit2. But it actually introduces the new MAC Dev section and siriShortcuts development. Let me talk about these seven parts in the order of presentation.

  1. The MAC dev. Updates to this part of the MAC are absolutely explosive. Apple has promised to open up this part of the capability (building The MAC app UI based on UIKit) to the public in 2019, which means that many iPad apps will be able to be ported to the MAC with less code changes. Apple already eats its own dogfood, and there are two or three apps on the MAC that are ported from ios. This will greatly enrich the MAC software ecosystem, and developers will benefit from it. In addition, also demonstrated the use and development of dark mode experience, very nice. On the whole, MAC developers are positive about this wave (fellow MAC developers are happy).
  2. Xcode10. Judging from the data presented on the spot, the improvement xCode10 has made to the Swift project compilation is simply explosive. Speed is generally increased by a factor of two or more because the entire XCODE10 compiler is partially rewritten and optimized entirely in Swift. Xcode10’s playground has also been greatly enhanced, evolving from just a beginner’s toy to a productivity tool that allows for things like ML tasks, simple IDEA validation work, and even framework readMes and demos. It supports the introduction of external frameworks, and it can also demonstrate the UI, which is faster, more powerful, more efficient, and more elegant than writing a scaffolding demo.
  3. Swift, 4.2. Swift isn’t my main development language, but it should be the future of iOS development. Swift 4.2 has improved in a number of ways, incorporating a lot of community submissions. And Swift 5 will also come to us in the future. Eventually Apple will solve the compatibility problem and integrate Swift into the system, which will reduce the package size. Specific technical improvements include compiler support, syntax updates, performance optimizations, etc. Apple expects the community to actively provide feedback and submissions during the beta phase, and its core team will ultimately decide whether community submissions will be incorporated. That said, the future of a particular Swift feature may be up to you.
  4. The new ML. Apple provides the Create ML tool for modeling directly on the MAC; In the latest ML, Apple can also significantly reduce the size of certain models (it seems to be based on transfer learning). Apple has provided new domain-specific apis for image classification detection, natural language understanding, and, I think, a dot (sorry, I can’t remember at 3am). New ML is a big deal for Apple. On-device ML allows Apple to benefit from ML without compromising the privacy of user data. IOS12’s photo album optimization is based on this technology.
  5. The metal. Again, this is an underlying technology, and Apple aims to give Metal explosive performance in graphics and GPU-related computing on iOS devices through its highly integrated and customized advantages. Their goal is to eventually replace OpengL/OpencL etc. The devices supported by Metal are very old, reflecting Apple’s ambition. Judging from the Benchmark data on hand, Metal does what it wants to do, it supports multiple platforms, and it gets a big performance boost from extending the GPU.
  6. Sirishortcuts. Here is to show you the whole process, create shortcuts need developers to do and so on, from the demo code should not be difficult to see, the specific pit what may need to be in the development process can be realized. In a new function of wechat small program (probably a release in March or so, I can’t remember the specific name), I felt similar to this process design, the difference is that one through search, the other through voice.
  7. Arkit2. From the keynote presentation, I think everyone’s already impressed. Here’s how they did it, the new concepts and API updates. Notably, the live facetime animoji avatar in the keynote presentation benefited from arkit2’s enhanced face capture technology. There are specific sessions at the back of arkit2, which I recommend you to watch.

This one took me two hours, 3 a.m. in SAN Jose. Really is some tired, so the back is relatively sloppy. Originally I wanted to make a summary of today’s content. I participated in 6 sessions and 1 lab, but I couldn’t write any more, so I had to drag my homework. Thank you for reading my article ~ I will continue to update

Making: https://github.com/dustturtle welcome to follow, hope can communicate with technical problems.