Show newer

For anyone who watched ONLY the main WWDC Keynote segment about Vision Pro and then decided Apple had ditched accessibility to leave blind people outside in the cold, I can absolutely recommend this session: “Create accessible spatial experiences”

developer.apple.com/wwdc23/100

#A11y #Accessibility #UIAccessibility #VisionPro #VoiceOver #WWDC #WWDC23

I think I’m one of the (few?) humans who could use the new Apple iFacePlate right now. I’ve got this project where I’m intensely editing a large complex doc, frequently accessing several other large complex docs (& browser) for materials. I have a big outboard screen, but still a painful amount of window shuffling. The ability to simultaneously display and read more BIG windows than any physical screen could manage would make my life way easier.

#VisionPro #apple

@_Davidsmith As I asked and partially answered in this toot: qoto.org/@danb/110505148037732 , what is much better at than laptops/phones, etc? The answer helps you then figure out which types of applications it's better for, and then for which apps now might be a good time to build/rethink.

@gallaugher I haven't been out to much since COVID, but has a variety and is adding more. Also, follow @scottkirsner

@_Davidsmith Did you get to try any widgets? How about widgets with input? Does it feel like enough space to have lots of them always around?

I was incredibly fortunate to have the opportunity to try Vision Pro this week. The experience was overwhelming in the best possible way. I'm still collecting my thoughts for a longer Design Diary post, but it was so transformative that I'm finding it hard to put the experience into words.

As I work on that, I wanted to ask for any questions folks had with regards to using it and more generally for the platform from a developer/designer perspective. I'll do my best to answer to them.

Another good experience write-up: daringfireball.net/2023/06/fir

It seems that Apple is "over the bar" on a variety of important "must haves". (One is the consistent "no nausea" reports, including from multiple females. Another is affordable for enough developers.) Maybe they finally got there so it's time to release to developers to innovate.

@ednl @ossa I guess that while the ear speakers are probably somewhat directional, sound may leak out as you surmise. Perhaps when you want more privacy you can switch to AirPods. (As a user of hearing aids, I'm happy that they went to an external speaker instead of earbuds or earphones.)

Thinking how Apple with no handheld controllers and highly crafted use of eyes/fingers mirrors the original iPhone vs. smartphones with keyboards. Also running full "desktop" browser vs stripped-down "mobile" ones.

@mikesax We'll see. For visually-orient people, organizing by space in 3D is very powerful. (You should see all of the piles around my desk and office...) For other, it may not. Sound and visual changes in your peripheral vision can help with navigating through multi-taking.

@mikesax I quite agree. A few years ago when I tried an AR system, as I recall, I saw how 3D charts were much better to comprehend when you could move it and you.

@mikesax Yes! Apple mentioned that, I think, how conferencing uses the 3D sound. Could add sounds to actions with 3D as we work together.

@mikesax Eye tracking could do that, but, for good privacy reasons, Apple is currently not giving any eye-tracking info to the app. It only gives the location of the gesture done there. (Though could be long gaze if enabled by user in Accessibility). We'll see how closed they keep this over time.

@awaterma @ossa Yes. Good point. But Apple (if you trust them) is not giving that to anybody nor sending off device. So, "privacy" is more of "screen not visible to people near you".

@awaterma @ossa Andrew: We are not giving reasons to buy, just to evaluate attributes to see which potential areas might open up. Isaac says others can't see what you see, unlike a laptop on an airplane. That's not kidding.

@danb
* Privacy - no one can see what you are working on or viewing…

Thinking about Apple vs laptops/iPads/phones/etc:

*** What is much better at? ***

Some obvious ones:
- Lots of pixels in wide field of view & lots of perceived 3rd dimension space => more places/ways to put/organize things
- Eye tracking instead of mouse/touch => standing/sitting no desk/lap, quicker, hands-free
- Finger(s?) flexing vs finger tip press => richer gesture language
- More immersive sound w/transparency => quality, aural cues including location

More?

I've seen and read a bunch of people's accounts with the #VisionPro, but the one from Tested is definitely the most in-depth and hype-restrained. youtube.com/watch?v=f0HBzePUmZ #WWDC23

Ooo boy, this is going to by quite a summer 😳.

@emilymbender is the most brilliant and generous teacher we have on what LLMs can, should, cannot, and should not be expected to do. I am so grateful that she uses social media to teach. Do read her Thai library thought experiment explaining language and understanding.
h/t @ct_bergstrom medium.com/@emilymenonbender/t

Show older
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.