Explore the integration of media technologies within your app. Discuss working with audio, video, camera, and other media functionalities.

All subtopics
Posts under Media Technologies topic

Post

Replies

Boosts

Views

Activity

Camera app best practices
As a reminder, the recommended approach to monitor camera rotations, including on upcoming hardware, is to use the AVCaptureDevice.RotationCoordinator / AVCaptureDeviceRotationCoordinator API. In many common scenarios on iPhone Duo, proper use of the rotation coordinator is the only way to ensure that your camera previews and captures use the orientation expected by the user. AVCaptureVideoOrientation has been deprecated as of iOS 17.0 and iPadOS 17.0. When switching cameras in your app, make sure to create a rotation coordinator for that device. To ensure that your app has implemented the rotation coordinator API correctly, you should test different orientations and sizes of your app on an iPad with Stage Manager enabled. Additional information: Sample Code: Supporting device rotation in your camera app Tech Talk: Build a great camera experience for iPhone Duo WWDC23 session: Support external cameras in your iPadOS app
0
0
501
Oct ’26
Is there an official SDK or licensing path for an AirPlay screen mirroring receiver on Windows?
I’m developing a Windows desktop application for guided smartphone support. I’d like the application to receive iPhone screen mirroring over a local network when the user selects it from Control Center. The use case is live display of ordinary device screens, such as the Home Screen and Settings. Does Apple provide an official receiver SDK, implementation documentation, or a licensing program for a Windows software receiver? If this is handled through a partner program, which team or application process should I contact, and is a software-only Windows product eligible? Thank you for any guidance.
0
0
68
14h
Requests for MusicKit apps: motion artwork, editorial artwork, lyrics and Browse groupings
I'm building a MusicKit-based Apple Music client that uses documented APIs only. A few things subscribers see in the Music app have no supported route for third-party apps, so I've filed enhancement requests. If you'd use any of these, please file a duplicate referencing the FB number so Apple can see the demand. 1. Motion artwork (editorialVideo): FB25664296 Albums, playlists, stations and artists have motion artwork, delivered by labels with each release, but the documented attributes include no editorialVideo, and an earlier answer in this forum said it isn't available to third-party apps. Since iOS 26, MPMediaItemAnimatedArtwork lets any music app show animated artwork on the Lock Screen, so a supported source for Apple Music's own motion artwork would fit naturally. 2. Editorial artwork, including artist logos: FB25664222 Wide hero and banner images for artists, albums, playlists and curators, and artists' logo or wordmark images, aren't in the documented attributes, which only include the square artwork. 3. Lyrics, including time-synced lyrics: FB25664234 MusicKit gives no access to lyric text, so subscribers lose lyrics, including time-synced and word-by-word lyrics, whenever they play through a MusicKit app. 4. Browse and editorial groupings: FB25664237 The New, Radio and Browse pages are built from groupings (moods and activities, curated rooms, Find Your Mood stations) that the Apple Music API doesn't list. An app can fetch an activity or a station by id, but has no documented way to discover which exist or how Apple groups them. For each, I've asked for a documented attribute or MusicKit property under whatever usage terms Apple needs (for example, shown only while the item is on screen or playing, never stored or redistributed). If anyone from Apple can say whether any of these are available today through a supported route, that would help too.
0
0
93
1d
iPhone 18 Pro: AVAudioEngine input tap returns all zeros after the Always-On Display turns off overnight
My app records audio overnight in the background: UIBackgroundModes audio, AVAudioSession category playAndRecord with mode measurement, and an AVAudioEngine with a tap on inputNode. On a customer's iPhone 18 Pro running iOS 27.2.1 (24B156), the tap starts delivering buffers of exact zeros about two hours into the night. It keeps delivering zeros until she picks the phone up in the morning. Her sysdiagnose shows the same sequence on three consecutive nights: powerd logs SmartPowerNap: enterSmartPowerNap. The backlight state changes from inactiveOnLive to suppressed, with the explanation "alwaysOn suppressed - SmartPowerNap". The panel reaches 0 nits about two seconds later. Under a second after that, every sample in the recording is 0. PowerLog's per-app mic RMS reads -240 from that point on. Hours later powerd logs Exiting SmartPowerNap. Session end reason MotionDetected. The display wakes and mic input returns within a second. Timing on the third night: 23:55:57.234 Smart Power Nap entry 23:55:59.14 panel at 0 nits 23:55:59.8 first zero sample in the recording 05:46:58.032 Smart Power Nap exit about 05:46:59 mic input returns During the silent hours: The app receives no interruption, route change, media services reset or AVAudioEngineConfigurationChange notification. The engine keeps running and the tap keeps firing on schedule. audiomxd logs no deactivation for the session and holds its power assertions throughout. The system never sleeps. I can't reproduce it. My iPhone 16 Pro on the same build logs "SmartPowerNap: feature not enabled or predictor not initialized" on every lock, so it never takes this path. Questions: Does iOS gate mic input by design while Smart Power Nap suppresses the Always-On Display? Can an app keep recording through it, or get a notification that input has stopped? Does restarting AVAudioEngine while the session stays active restore input in this state? I can detect a run of exact zeros and restart the engine, but I have no device to test it on. Has anyone else with iPhone 18 Pro users seen this? I filed FB25663635 with the sysdiagnose attached.
0
0
73
1d
IOSurface with System Extensions
Hi All, I'm working on a camera system extension where the main app is supposed to transfer a video stream using IOSurface memory sharing to the cam extension. I have built a sample app that does contains all the logic, but without a camera extension. So I'm essentially using IOSurface to render a video in one SwiftUI view and show the result in another SwiftUI view. Just for testing purposes. And everything works fine so far. Now, when moving the receiver code to the camera extensions, I'm having problems in accessing the IOSurface via ID. I am sharing the IOSurface ID via UserDefaults. I know from the logs the ID is correctly transferred. Here is the code that uses IOSurfaceLookup to get the IOSurface. But this fails with the given message. The error message prints the surface ID which is the correct one. I know this from the main app where I get the ID and print it as well. private var surfaceId: Int = -1 { didSet { logger.info("surfaceId has changed") if surfaceId == -1 { stopReceivingFrames() ioSurface = nil } else { guard let surface = IOSurfaceLookup(IOSurfaceID(surfaceId)) else { logger.error("failed to lookup IOSurface with ID: \(self.surfaceId)") return } self.ioSurface = surface logger.info("surface set, now starting receiving frames") startReceivingFrames() } } } My gut feeling says that this issue might be related to some missing entitlement, sandboxing. In general, I have a working camera extension. I'm just not able to render a video in the main app, and send it over to the camera extension to overlay another web cam. Both, the main app and camera extension are in the same XCode workspace and share the same AppGroup. In short, my actual questions are: Is there any entitlement required for using IOSurface between app and camera system extension? Is using IOSurface actually possible in system extensions? Is there any specific setting/requirement that I need to handle to make this work?
1
1
1.3k
1d
Playback volume stays low with PlayAndRecord/VoiceChat and remains low for a few seconds after restoring SoloAmbient (iPhone Air, iOS 26)
Hello, I'm developing a speech recognition app with Unity 6000.0.58f2. The app also has other content besides speech recognition, so I switch the AVAudioSession only when the user needs to speak, and restore it once recording is no longer needed. On iPhone Air (iOS 26), I'm seeing the following issues: While the session is set to PlayAndRecord with VoiceChat mode, playback volume is consistently lower than normal. After restoring the session to SoloAmbient, playback volume stays low for a few seconds before returning to normal. I'd like to avoid this volume drop. Any advice or recommended approach would be greatly appreciated. [Implementation] I use a native iOS plugin (.mm file) called from Unity. When the user starts speaking, I enable recording with: success = [session setCategory:AVAudioSessionCategoryPlayAndRecord mode:AVAudioSessionModeVoiceChat options:AVAudioSessionCategoryOptionDefaultToSpeaker | AVAudioSessionCategoryOptionAllowBluetooth error:&error];After speaking ends, I restore the session with: success = [session setCategory:AVAudioSessionCategorySoloAmbient error:&error]; success = [session setMode:AVAudioSessionModeDefault error:&error];[Environment] Device: iPhone Air iOS: 26.[x] Unity: 6000.0.58f2 Reproduces on other devices / iOS versions: [Yes / No — e.g. iPhone 15 (iOS 18.x) does not reproduce] Output route: built-in speaker [/ Bluetooth: ___ ] [Questions] Is the lower playback volume in VoiceChat mode expected behavior due to voice processing (echo cancellation / ducking)? If so, is there a recommended way to keep playback volume at a normal level while recording for speech recognition (e.g. using a different mode such as Default or Measurement, or adjusting voice processing ducking)? What is the recommended sequence for restoring the session so that playback volume returns to normal immediately? For example, should I call setActive:NO (with NotifyOthersOnDeactivation) before changing the category, or set the category and mode together in a single call? Is there any behavior change in iOS 26 or anything specific to iPhone Air that could cause this? Thank you in advance.
0
0
155
2d
Feature Request: Allow Independent Bluetooth Microphone Input and Speaker Output on iPhone
I hope iphone can consider adding this feature in a future update. We are now living in the era of content creation and social media. With the growing popularity of Bluetooth wireless microphones, more and more people are using external microphones for gaming, live streaming, video calls, and content creation. However, there is a frustrating limitation: when connecting a Bluetooth microphone, the phone may automatically route audio output to the same Bluetooth device. This means users cannot freely use an external microphone for input while keeping the phone's built-in speakers for audio output. What we really need is the ability to independently select audio input and output devices at the system level, just like on a PC. For example: Audio input: DJI wireless microphone Audio output: Phone's built-in speakers This would be extremely useful for mobile gamers, streamers, content creators, and anyone who uses an external microphone regularly. I believe this is becoming an increasingly important feature as wireless microphones become more common. Please consider adding independent microphone input and audio output selection in a future update. Thank you!
0
0
31
2d
BlietoothHFP to MFi hearingaids
Is it possible to port a bluetooth microphone (BluetoothHFP) to MFi hearing aids connected to an iPhone. When I try to do that the BluetoothHFP grabs input and output. When I pull the output away (BluetoothA2DP) it gives up the input.
6
0
549
2d
3D scanning and 3D model with texture mapping
I am new here and would appreciate help in coding or an explanation what to use in swift for an app which will be able to capture LiDAR scanning and RGB data from taken pictures, generate a 3D mesh, and create .OBJ, .MTL, and .JPEG file set for further manipulation of 3D model. I am able to create from LiDAR scanning 3D mesh and .OBJ file but can not generate .MTL and .JPEG for a texture of 3D model.
2
0
1.2k
3d
Hi-Res Lossless audio output on Apple TV 4K for third-party apps (tvOS 27)
Hello, I'm reaching out on behalf of Qobuz, a music streaming service that supports Hi-Res audio on all platforms. We have just released our Apple TV app, and we need to confirm the audio output limits that apply to third-party apps on tvOS. Here is our current understanding: Up to tvOS 26, audio output is limited by the system to 24-bit/48 kHz on all Apple TV models. Higher sample rates are resampled by tvOS. Starting with tvOS 27, Apple TV 4K (2021 and 2022 models) supports Hi-Res Lossless output up to 24-bit/192 kHz when connected over HDMI to compatible audio equipment (AV receiver or DAC). On our side, Qobuz streams and decodes audio up to 24-bit/192 kHz on Apple TV, and we don't restrict the resolution of our catalogue. Could you please confirm: Whether Hi-Res Lossless output up to 24-bit/192 kHz on tvOS 27 is available to all third-party apps, or only to Apple Music. If it is available to third-party apps, which APIs or configuration (e.g. AVAudioSession preferred sample rate, AVPlayer vs. AVSampleBufferAudioRenderer, entitlements) are required to get bit-perfect output at the source sample rate. Whether our understanding of the limits above is correct, including the supported Apple TV models. Thank you in advance for your help. Best regards, Jérémie Senior iOS Developer, Qobuz
0
1
137
3d
Media Extension format reader for MKV/WebM in several apps of one developer – appropriate use and conflicts?
I'm preparing several sandboxed macOS apps (macOS 26 and later) for the Mac App Store and would like to add Matroska/WebM support through a Media Extension format reader. Before implementing it, I'd like to clarify a few points. The apps work only with local video files the user opens or adds: a player for many videos at once (video wall), a practice player with loops and markers, an app for precise trimming and export, and a catalog of the user's video library with thumbnails and duplicate detection. None of them is network-facing. Plan: one format reader for Matroska and WebM (own implementation of RFC 9559, no third-party code), embedded as an ExtensionKit bundle. Video is decoded by the system decoders (H.264, HEVC, VP9 after VTRegisterSupplementalVideoDecoderIfAvailable, AV1 where available); no own video decoder. Each app calls MTRegisterProfessionalVideoWorkflowFormatReaders() and VTRegisterProfessionalVideoWorkflowVideoDecoders() at launch and shows a notice with a link to System Settings when the extension is disabled (AVErrorMediaExtensionDisabled). Questions: MTProfessionalVideoWorkflow.h and VTProfessionalVideoWorkflow.h say the registration functions are intended for applications supporting professional video workflows. Is it acceptable to call them from apps like these, which serve video editing, review and library management, but not a broadcast or camera workflow? Users may buy only one of the apps, so I'd embed the same format reader (same ClassImplementationID and CFBundleVersion, bundle identifier prefixed by each host app) in every app. Is that supported? When are AVErrorMediaExtensionConflict and kVTExtensionConflictErr returned, and how can they be avoided? Does the enable switch in System Settings apply per ClassImplementationID or per host app? Would a user who installs a second app have to enable the extension again? Is there a supported way to open System Settings directly at General > Login Items & Extensions > Media Extensions from an app? Are there App Review requirements specific to apps that embed Media Extensions, beyond guidelines 2.4.5 and 4.4? Thanks in advance.
3
0
412
3d
Camera preview rotated 90 degrees on initial presentation on iPadOS 27.2.1, corrected after returning from Control Center
Dear Apple Support Team, We are investigating a camera preview orientation issue on an iPad and would appreciate guidance on the relevant UIKit and AVFoundation behavior. Our app uses Flutter and the third-party Regula Document Reader SDK for passport MRZ scanning. We understand that third-party SDK internals are outside Apple’s support scope. Our question concerns the relationship between the active interface orientation, presentation lifecycle, and camera preview connection orientation. Environment Device: iPad (A16), hardware identifier iPad15,7 iPadOS: 27.2.1, as reported by the device and diagnostic export App distribution: TestFlight App version in the diagnostic log: 2.0.14, build 7 Flutter plugin: flutter_document_reader_api 9.8.1718 Runtime Regula SDK API version: 9.8.6944 Runtime Regula SDK Core version: 9.8.20492 Steps to reproduce Hold the affected iPad in landscape orientation and open the app. Open the passport scanner. The scanner interface appears in landscape, but the camera image appears rotated by 90 degrees. Open Control Center, then dismiss it and return to the app. The preview can then appear in the correct orientation. Close and reopen the scanner; the issue may recur. Physically rotating the device does not consistently resolve the issue. Expected: The preview should match the current interface orientation from initial presentation. Actual: The preview initially has an orientation mismatch and may recover only after leaving and returning to the app. Diagnostic observations We collected initial-entry and app-resume observations within the same scanner session: Before scanner presentation, the active UIWindowScene.interfaceOrientation is landscapeRight. The SDK’s presenting view controller belongs to the active application window. The scanner controller has landscape dimensions of approximately 1180 × 820. The third-party SDK’s supported interface orientation is configured for landscape right. However, the initial preview connection reports videoOrientation = portrait and videoRotationAngle = 90. Updating supported interface orientations and requesting layout updates did not resolve the initial mismatch in this test. A subsequent app-resume observation reports videoOrientation = landscapeRight and videoRotationAngle = 0. This change is recorded before our app’s delayed layout refresh. We recognize that interface orientation and capture rotation are different concepts, and that connection metadata alone does not establish the displayed pixel orientation. We are providing these observations alongside the visible symptom rather than treating a particular angle as universally correct. Scope and investigation status Our separate QR scanner and receipt camera work normally on the same device. The passport scanner also works normally on many other iPads. We have not established that this affects all devices running this iPadOS version. An app-side orientation enum comparison issue was corrected before collecting the build 7 log, but the preview mismatch remained. We have not isolated the cause to iPadOS, our presentation code, or the SDK’s capture initialization. We do not yet have a focused standalone Xcode reproduction project. We are also preparing an inquiry to the SDK vendor. Questions Are there known circumstances in which a camera preview initially uses portrait orientation despite being presented in a landscape UIWindowScene? What is the recommended lifecycle point for determining the initial interface orientation and configuring the preview connection, particularly while presentation or rotation transitions are in progress? Which supported APIs should be used to keep preview rotation synchronized with interface changes on this iPadOS version? Could the recovery after dismissing Control Center indicate an initialization or lifecycle ordering issue? What additional observations would help distinguish these possibilities? What should we include in a minimal native reproduction or system diagnostic collection to make this issue actionable? We can provide a symptom video and an application diagnostic export. These were collected in separate tests on the same affected device and are not time-synchronized. The application export is not an Apple sysdiagnose. Thank you for any guidance on how to investigate this further. With Best Regards, GTF_Japan_Service
0
0
37
3d
Supported diagnostics for a natural playback transition failure in a WKWebView hosting music.apple.com
We are evaluating an unreleased iPhone app that embeds the complete official music.apple.com page in WKWebView. The official website displays its own lyrics. Our app retains an independent website sign-in and local listening tools. A JavaScript bridge observes playback metadata and provides explicit transport commands through the page's existing MusicKit instance. It does not create a developer-owned MusicKit instance or extract lyrics, credentials, protected audio addresses, or DRM data. On an iPhone 14 Pro Max running iOS 27.2.1, a foreground track can play to its natural end, after which the queue position advances but the next track remains stopped at time zero. A filtered error observation reports MKError with reason NETWORK_ERROR. This identifies the SDK error category, not the underlying cause or request owner. The failure was observed before Safari inspection was attached as well as during inspection. Safari Web Inspector can connect to the app's main page. Our metadata-only observations include a fetch row with HTTP 200 and several subsequent fetch rows with no displayed HTTP status. We have not captured request addresses, headers, cookies, response bodies, HAR files, lyric text, or raw stacks. These rows cannot currently be linked to the SDK error. An earlier actual-zero-user-script control with the full native model and layout completed one foreground transition and continued playing the next track for 51 seconds. This is not a current matched comparison and does not identify a specific bridge operation. The complete bridge can also complete transitions in a separate Mac host. We have no deterministic minimal reproducer establishing an Apple or WebKit defect. The official-website branch leaves Media Session and audio-session ownership to the website and does not issue automatic next-track commands. No proposed global fetch wrapper has been installed, because adding Promise rejection handlers changes observable rejection behavior. We are seeking guidance before expanding instrumentation or requesting more real-device test time. Questions concerning this single transition failure: Is full music.apple.com playback in a third-party WKWebView, alongside observation and explicit transport through the page's existing MusicKit instance, a supported integration pattern? If not, which supported integration preserves a website account independent of the iPhone's Media & Purchases account? Which public diagnostics can distinguish cancellation from transport failure at this transition without exposing protected resource addresses, authorization values, response content, or raw stacks? Are there documented event-listener reentrancy, WKWebView lifecycle, or audio-session constraints that this host should follow when observing the existing player? Environment: iPhone 14 Pro Max; iOS 27.2.1; macOS 27.2.1; Xcode 27.2 (27B52). Experimental app version 0.65, build 67, not submitted. The existing public version is unchanged. Attachments: None. This draft contains no account identifiers, device identifiers, real-session logs, signing material, or source attachments.
1
0
171
4d
403 / 40300 "Invalid authentication" on every /me request, even with a new key and Media ID
My MusicKit setup worked for about a week, then every request that uses a Music User Token started failing with 403, code 40300, "Invalid authentication". That includes GET /v1/me/storefront. Catalogue requests with the same developer token still work. What I've tried, none of which helped: Signing in again through MusicKit JS (the sign-in itself succeeds) A new MusicKit key, twice A new Media ID with a new key tied to it Accepting the latest program agreements, then signing in again MusicKit JS in Safari gets the same refusal right after sign-in, so it isn't my server code. My Apple Music subscription is active, and I'm signing in with the account that holds it. Has anyone seen user tokens rejected like this and found the cause? I've seen a suggestion that an Apple Account password change can trigger it, but nothing about how to recover. Feedback filed as FB25575398
1
0
342
4d
Let Audio Units read the project's whole tempo and signature map (FB25609451)
I've filed FB25609451 and I'm posting it here so other Audio Unit developers can add their own feedback if they need the same. What I'd love in Logic Pro (and any AU host) is what REAPER already does for plug-ins: you insert the plug-in and it immediately knows the whole song, every bar's time signature and tempo, without playing anything, and it updates right away when you change a signature or tempo. In REAPER this works through its host interface (IReaperHostApplication): the plug-in calls TimeMap_GetMeasureInfo to read the start, time signature and tempo of any bar. For Audio Units today, HostCallback_GetBeatAndTempo / HostCallback_GetMusicalTimeLocation (AUv2) and musicalContextBlock / transportStateBlock (AUv3) give the current tempo and time signature, but nothing about the other bars. So a time-aware plug-in has to hear the song played through once, or the user pastes the Signature List into it and redoes it after every edit. Suggestion, read-only: A way for an Audio Unit to read the project's tempo and signature map (Signature track and Tempo track), for example a host callback for AUv2 and a block or property on AUAudioUnit for AUv3, returning every event with its position, time signature and tempo. A notification when the user edits them. Also useful: the current bar number in musicalContextBlock / HostCallback_GetMusicalTimeLocation, and the playback rate during Varispeed. It would help click and count-in tools, arpeggiators and sequencers, tempo-synced effects, and notation or visual displays. If you need this too, filing your own feedback that mentions FB25609451 helps. Leo Margarit, Margarit Audio (OddClick)
0
0
49
5d
Is Apple Music artwork allowed in a music discovery app without playback?
Hi Apple Developer Community, I'm developing an iOS app focused on music discovery and social interaction. Users can share songs with people nearby, and I'd like to use the Apple Music API to retrieve song metadata and album artwork. The artwork would appear on map markers, shared song cards, and user music profiles. The app is not primarily a music player, and users would be able to open songs in Apple Music. I'd like to clarify: Is this use of Apple Music metadata and album artwork permitted under the MusicKit / Apple Music API terms, even without in-app music playback? Would displaying artwork in these social discovery contexts require additional licensing or permission? If additional permission is needed, which official Apple team or licensing channel should I contact? I want to ensure the app complies with Apple's terms before release. Thank you for your guidance!
0
0
170
5d
MusicKitJS | Cannot play explicit songs | CONTENT_RESTRICTED
[Ticket on Feedback Assistant FB12353357] Hi there, We’re experiencing issues playing explicit songs using MusicKitJS for the Web (tested on both stable v1 and beta v3). Upon calling the SDK’s “play()” function, the following error gets logged in the console “CONTENT_RESTRICTED: Content restricted” and playback doesn’t begin. The Storefront we’ve tested in is “it”, but very likely all of them are impacted with the issue, here’s a few Adam IDs of affected tracks: 1681182396, 1683117248, 1669607876. A quick check with the REST APIs reveals indeed that the relevant thing all 3 of them have in common is "contentRating" being "explicit”. The bug isn’t however easy or predictable to replicate because it seems that it can be somewhat solved by fiddling with both the “Screen Time” restrictions settings within an iOS/iPadOS device (of course logged in with the same Apple account), as well as with the “Parental Controls” dashboard located in the Web version of the Apple Music’s settings page. We’re still not 100% sure what exactly “triggers” the fix, but both mentioned dashboards above are essential in attempting to solve it by trial and error. Specifically: in the “Parental Controls” dashboard what helps is actually turning ON the restrictions with the toggle, and then easing them up the most by specifically setting the less restricted available option in all 3 dropdown menus (pretty baffling); in the “Screen time” dashboard what helps is simply enabling/disabling the feature itself altogether, as well as the “Content & Privacy restrictions” toggle, and changing the level of allowed content between “Clean” and “Explicit”; I also want to highlight the fact that during the entire process, for the issue to be actually solved, users every time had to to restart their iPhone/iPad multiple times after changing a setting in “Screen time”, along with deauthorizing/authorizing (logging out and back in) their Apple Music account from the MusicKitJS SDK. The issue seems to always affect freshly created Apple accounts right from the start, we’re not aware of methods that can lead to the bug “coming back” and starting to happen again after being solved manually with the process above (meddling “randomly” with dashboards). It’s a pretty serious one because many of our users do not posses an Apple device and only use their Apple Music subscription on the Web and/or their Android device, meaning that the “Screen time” dashboard isn’t available for them. We’ve never been able to solve the problem on an Apple ID account solely by fiddling with the “Parental Controls” dashboard located in the Web version of the Apple Music’s settings page: tinkering with the “Screen time” settings was essential every single time, meaning owning an Apple device is essential to solve it. Last thing I’m adding is that the issue doesn’t seem to also affect listening to these explicit songs directly with the various first-party Apple Music clients (tested on the iOS native app, Android native app, and on the Apple Music WebApp). Steps to reproduce: on the Web, create a new Apple ID account and activate an Apple Music subscription (do not login with said account on an Apple device); go to the Apple Music WebApp settings page at music.apple.com/account/settings and make sure that the “Parental Controls” restrictions are turned OFF; open any explicit song in the Apple Music WebApp and confirm that playback is allowed; login and authorize the newly created account using any website/application integrated with the MusicKitJS SDK (v1 or v3, doesn’t matter); open the same explicit song as before (or any other) in said third-party client that uses the SDK and verify that playback doesn’t begin and an error “CONTENT_RESTRICTED: Content restricted” is logged in the console upon playing. Additional infos: Apple ID account region and language: Italy - Italian; Storefront affected: IT but possibly all of them; MusicKitJS versions affected: both v1 and v3; Browser where the issue was reproduced: Chrome v114. Attached you’ll find some informational screenshots. Thanks!
3
0
2.1k
5d
iOS ScreenCaptureKit: background frame processing and capture scope
I’m evaluating ScreenCaptureKit for an explicitly user-initiated, on-device text-recognition workflow on iPhone. Apple’s “Capturing screen content on iOS” sample currently describes iOS 27 full-display capture and capture continuing while the app is backgrounded. Before building a minimal prototype, I’d like to clarify: Can screen frames continue to be delivered and processed locally using Vision for text recognition while another app is foregrounded? What background configuration and processing limitations apply? Can capture on iPhone be restricted to a specific third-party app, or are the available scopes full-display capture and the capturing app’s own content? Is there a supported way to detect that the user has left the intended capture source and stop capture? Are there documented restrictions on capturing system apps, particularly Messages? The intended configuration has explicit system authorization, a visible capture indication, stop/cancel controls, no audio or camera capture, no network transmission, and no retained screen recording. Temporary recognition results would expire and be discarded; only explicitly user-selected output would be retained. This is a capability investigation, not a report of an observed failure. I haven’t run a device prototype yet.
0
0
142
5d
Mouse/Window Lag 4K Display
Hi, all! I recently redid my set up and bought a 44" 4K Samsung TV to mirror the display on my Macbook air. I connected everything using a Hyper Display HDMI hub. Everything is connecting ok, but I'm noticing that there is a slight lag in my mouse and display. The refresh rate is set to 60 and my display is set to 1920x1080. I've tried looking up everything and have had no luck. Any help would be appreciated!
0
0
31
5d
AUHAL input callback teardown: when is inputProcRefCon safe to release?
I am developing a macOS application that captures audio through an AUHAL input AudioUnit. The application registers an input callback using kAudioOutputUnitProperty_SetInputCallback. The callback receives an application-owned context through inputProcRefCon and obtains input audio using AudioUnitRender. The intended shutdown sequence is: Close application-level callback admission. Call AudioOutputUnitStop. Remove the callback using AudioUnitSetProperty with a zero-initialized AURenderCallbackStruct. Wait for callbacks already entered by the application to finish. Call AudioUnitUninitialize and AudioComponentInstanceDispose. Release the application-owned callback context. We use an atomic active-callback counter, covering all context accesses made by callbacks that have entered the counted region. However, this counter cannot account for a callback that Core Audio may have already dispatched but that has not yet executed its first instruction. My question: Is there a supported AUHAL teardown sequence that guarantees no previously scheduled, dispatched, or executing input callback can subsequently access inputProcRefCon? Specifically, does successful return from AudioOutputUnitStop, callback removal, AudioUnitUninitialize, or AudioComponentInstanceDispose provide such a guarantee? Is passing an AURenderCallbackStruct with both fields set to NULL a supported way to remove the input callback, and does removal have any documented completion semantics? If none of these operations provides the required guarantee independently, what is the recommended lifetime-management pattern for safely releasing the application-owned callback context? I have prepared a small standalone AUHAL test project that compiles the relevant Core Audio operations and passes deterministic offline lifecycle tests. Physical AUHAL activation and native callback teardown have not yet been executed, so I am not claiming a reproduced crash or verified native behavior. I am primarily seeking clarification of the supported Core Audio API contract, rather than a diagnosis of an observed crash. Thank you.
0
0
104
6d
Camera app best practices
As a reminder, the recommended approach to monitor camera rotations, including on upcoming hardware, is to use the AVCaptureDevice.RotationCoordinator / AVCaptureDeviceRotationCoordinator API. In many common scenarios on iPhone Duo, proper use of the rotation coordinator is the only way to ensure that your camera previews and captures use the orientation expected by the user. AVCaptureVideoOrientation has been deprecated as of iOS 17.0 and iPadOS 17.0. When switching cameras in your app, make sure to create a rotation coordinator for that device. To ensure that your app has implemented the rotation coordinator API correctly, you should test different orientations and sizes of your app on an iPad with Stage Manager enabled. Additional information: Sample Code: Supporting device rotation in your camera app Tech Talk: Build a great camera experience for iPhone Duo WWDC23 session: Support external cameras in your iPadOS app
Replies
0
Boosts
0
Views
501
Activity
Oct ’26
Is there an official SDK or licensing path for an AirPlay screen mirroring receiver on Windows?
I’m developing a Windows desktop application for guided smartphone support. I’d like the application to receive iPhone screen mirroring over a local network when the user selects it from Control Center. The use case is live display of ordinary device screens, such as the Home Screen and Settings. Does Apple provide an official receiver SDK, implementation documentation, or a licensing program for a Windows software receiver? If this is handled through a partner program, which team or application process should I contact, and is a software-only Windows product eligible? Thank you for any guidance.
Replies
0
Boosts
0
Views
68
Activity
14h
Requests for MusicKit apps: motion artwork, editorial artwork, lyrics and Browse groupings
I'm building a MusicKit-based Apple Music client that uses documented APIs only. A few things subscribers see in the Music app have no supported route for third-party apps, so I've filed enhancement requests. If you'd use any of these, please file a duplicate referencing the FB number so Apple can see the demand. 1. Motion artwork (editorialVideo): FB25664296 Albums, playlists, stations and artists have motion artwork, delivered by labels with each release, but the documented attributes include no editorialVideo, and an earlier answer in this forum said it isn't available to third-party apps. Since iOS 26, MPMediaItemAnimatedArtwork lets any music app show animated artwork on the Lock Screen, so a supported source for Apple Music's own motion artwork would fit naturally. 2. Editorial artwork, including artist logos: FB25664222 Wide hero and banner images for artists, albums, playlists and curators, and artists' logo or wordmark images, aren't in the documented attributes, which only include the square artwork. 3. Lyrics, including time-synced lyrics: FB25664234 MusicKit gives no access to lyric text, so subscribers lose lyrics, including time-synced and word-by-word lyrics, whenever they play through a MusicKit app. 4. Browse and editorial groupings: FB25664237 The New, Radio and Browse pages are built from groupings (moods and activities, curated rooms, Find Your Mood stations) that the Apple Music API doesn't list. An app can fetch an activity or a station by id, but has no documented way to discover which exist or how Apple groups them. For each, I've asked for a documented attribute or MusicKit property under whatever usage terms Apple needs (for example, shown only while the item is on screen or playing, never stored or redistributed). If anyone from Apple can say whether any of these are available today through a supported route, that would help too.
Replies
0
Boosts
0
Views
93
Activity
1d
iPhone 18 Pro: AVAudioEngine input tap returns all zeros after the Always-On Display turns off overnight
My app records audio overnight in the background: UIBackgroundModes audio, AVAudioSession category playAndRecord with mode measurement, and an AVAudioEngine with a tap on inputNode. On a customer's iPhone 18 Pro running iOS 27.2.1 (24B156), the tap starts delivering buffers of exact zeros about two hours into the night. It keeps delivering zeros until she picks the phone up in the morning. Her sysdiagnose shows the same sequence on three consecutive nights: powerd logs SmartPowerNap: enterSmartPowerNap. The backlight state changes from inactiveOnLive to suppressed, with the explanation "alwaysOn suppressed - SmartPowerNap". The panel reaches 0 nits about two seconds later. Under a second after that, every sample in the recording is 0. PowerLog's per-app mic RMS reads -240 from that point on. Hours later powerd logs Exiting SmartPowerNap. Session end reason MotionDetected. The display wakes and mic input returns within a second. Timing on the third night: 23:55:57.234 Smart Power Nap entry 23:55:59.14 panel at 0 nits 23:55:59.8 first zero sample in the recording 05:46:58.032 Smart Power Nap exit about 05:46:59 mic input returns During the silent hours: The app receives no interruption, route change, media services reset or AVAudioEngineConfigurationChange notification. The engine keeps running and the tap keeps firing on schedule. audiomxd logs no deactivation for the session and holds its power assertions throughout. The system never sleeps. I can't reproduce it. My iPhone 16 Pro on the same build logs "SmartPowerNap: feature not enabled or predictor not initialized" on every lock, so it never takes this path. Questions: Does iOS gate mic input by design while Smart Power Nap suppresses the Always-On Display? Can an app keep recording through it, or get a notification that input has stopped? Does restarting AVAudioEngine while the session stays active restore input in this state? I can detect a run of exact zeros and restart the engine, but I have no device to test it on. Has anyone else with iPhone 18 Pro users seen this? I filed FB25663635 with the sysdiagnose attached.
Replies
0
Boosts
0
Views
73
Activity
1d
IOSurface with System Extensions
Hi All, I'm working on a camera system extension where the main app is supposed to transfer a video stream using IOSurface memory sharing to the cam extension. I have built a sample app that does contains all the logic, but without a camera extension. So I'm essentially using IOSurface to render a video in one SwiftUI view and show the result in another SwiftUI view. Just for testing purposes. And everything works fine so far. Now, when moving the receiver code to the camera extensions, I'm having problems in accessing the IOSurface via ID. I am sharing the IOSurface ID via UserDefaults. I know from the logs the ID is correctly transferred. Here is the code that uses IOSurfaceLookup to get the IOSurface. But this fails with the given message. The error message prints the surface ID which is the correct one. I know this from the main app where I get the ID and print it as well. private var surfaceId: Int = -1 { didSet { logger.info("surfaceId has changed") if surfaceId == -1 { stopReceivingFrames() ioSurface = nil } else { guard let surface = IOSurfaceLookup(IOSurfaceID(surfaceId)) else { logger.error("failed to lookup IOSurface with ID: \(self.surfaceId)") return } self.ioSurface = surface logger.info("surface set, now starting receiving frames") startReceivingFrames() } } } My gut feeling says that this issue might be related to some missing entitlement, sandboxing. In general, I have a working camera extension. I'm just not able to render a video in the main app, and send it over to the camera extension to overlay another web cam. Both, the main app and camera extension are in the same XCode workspace and share the same AppGroup. In short, my actual questions are: Is there any entitlement required for using IOSurface between app and camera system extension? Is using IOSurface actually possible in system extensions? Is there any specific setting/requirement that I need to handle to make this work?
Replies
1
Boosts
1
Views
1.3k
Activity
1d
Playback volume stays low with PlayAndRecord/VoiceChat and remains low for a few seconds after restoring SoloAmbient (iPhone Air, iOS 26)
Hello, I'm developing a speech recognition app with Unity 6000.0.58f2. The app also has other content besides speech recognition, so I switch the AVAudioSession only when the user needs to speak, and restore it once recording is no longer needed. On iPhone Air (iOS 26), I'm seeing the following issues: While the session is set to PlayAndRecord with VoiceChat mode, playback volume is consistently lower than normal. After restoring the session to SoloAmbient, playback volume stays low for a few seconds before returning to normal. I'd like to avoid this volume drop. Any advice or recommended approach would be greatly appreciated. [Implementation] I use a native iOS plugin (.mm file) called from Unity. When the user starts speaking, I enable recording with: success = [session setCategory:AVAudioSessionCategoryPlayAndRecord mode:AVAudioSessionModeVoiceChat options:AVAudioSessionCategoryOptionDefaultToSpeaker | AVAudioSessionCategoryOptionAllowBluetooth error:&error];After speaking ends, I restore the session with: success = [session setCategory:AVAudioSessionCategorySoloAmbient error:&error]; success = [session setMode:AVAudioSessionModeDefault error:&error];[Environment] Device: iPhone Air iOS: 26.[x] Unity: 6000.0.58f2 Reproduces on other devices / iOS versions: [Yes / No — e.g. iPhone 15 (iOS 18.x) does not reproduce] Output route: built-in speaker [/ Bluetooth: ___ ] [Questions] Is the lower playback volume in VoiceChat mode expected behavior due to voice processing (echo cancellation / ducking)? If so, is there a recommended way to keep playback volume at a normal level while recording for speech recognition (e.g. using a different mode such as Default or Measurement, or adjusting voice processing ducking)? What is the recommended sequence for restoring the session so that playback volume returns to normal immediately? For example, should I call setActive:NO (with NotifyOthersOnDeactivation) before changing the category, or set the category and mode together in a single call? Is there any behavior change in iOS 26 or anything specific to iPhone Air that could cause this? Thank you in advance.
Replies
0
Boosts
0
Views
155
Activity
2d
Feature Request: Allow Independent Bluetooth Microphone Input and Speaker Output on iPhone
I hope iphone can consider adding this feature in a future update. We are now living in the era of content creation and social media. With the growing popularity of Bluetooth wireless microphones, more and more people are using external microphones for gaming, live streaming, video calls, and content creation. However, there is a frustrating limitation: when connecting a Bluetooth microphone, the phone may automatically route audio output to the same Bluetooth device. This means users cannot freely use an external microphone for input while keeping the phone's built-in speakers for audio output. What we really need is the ability to independently select audio input and output devices at the system level, just like on a PC. For example: Audio input: DJI wireless microphone Audio output: Phone's built-in speakers This would be extremely useful for mobile gamers, streamers, content creators, and anyone who uses an external microphone regularly. I believe this is becoming an increasingly important feature as wireless microphones become more common. Please consider adding independent microphone input and audio output selection in a future update. Thank you!
Replies
0
Boosts
0
Views
31
Activity
2d
BlietoothHFP to MFi hearingaids
Is it possible to port a bluetooth microphone (BluetoothHFP) to MFi hearing aids connected to an iPhone. When I try to do that the BluetoothHFP grabs input and output. When I pull the output away (BluetoothA2DP) it gives up the input.
Replies
6
Boosts
0
Views
549
Activity
2d
3D scanning and 3D model with texture mapping
I am new here and would appreciate help in coding or an explanation what to use in swift for an app which will be able to capture LiDAR scanning and RGB data from taken pictures, generate a 3D mesh, and create .OBJ, .MTL, and .JPEG file set for further manipulation of 3D model. I am able to create from LiDAR scanning 3D mesh and .OBJ file but can not generate .MTL and .JPEG for a texture of 3D model.
Replies
2
Boosts
0
Views
1.2k
Activity
3d
Hi-Res Lossless audio output on Apple TV 4K for third-party apps (tvOS 27)
Hello, I'm reaching out on behalf of Qobuz, a music streaming service that supports Hi-Res audio on all platforms. We have just released our Apple TV app, and we need to confirm the audio output limits that apply to third-party apps on tvOS. Here is our current understanding: Up to tvOS 26, audio output is limited by the system to 24-bit/48 kHz on all Apple TV models. Higher sample rates are resampled by tvOS. Starting with tvOS 27, Apple TV 4K (2021 and 2022 models) supports Hi-Res Lossless output up to 24-bit/192 kHz when connected over HDMI to compatible audio equipment (AV receiver or DAC). On our side, Qobuz streams and decodes audio up to 24-bit/192 kHz on Apple TV, and we don't restrict the resolution of our catalogue. Could you please confirm: Whether Hi-Res Lossless output up to 24-bit/192 kHz on tvOS 27 is available to all third-party apps, or only to Apple Music. If it is available to third-party apps, which APIs or configuration (e.g. AVAudioSession preferred sample rate, AVPlayer vs. AVSampleBufferAudioRenderer, entitlements) are required to get bit-perfect output at the source sample rate. Whether our understanding of the limits above is correct, including the supported Apple TV models. Thank you in advance for your help. Best regards, Jérémie Senior iOS Developer, Qobuz
Replies
0
Boosts
1
Views
137
Activity
3d
Media Extension format reader for MKV/WebM in several apps of one developer – appropriate use and conflicts?
I'm preparing several sandboxed macOS apps (macOS 26 and later) for the Mac App Store and would like to add Matroska/WebM support through a Media Extension format reader. Before implementing it, I'd like to clarify a few points. The apps work only with local video files the user opens or adds: a player for many videos at once (video wall), a practice player with loops and markers, an app for precise trimming and export, and a catalog of the user's video library with thumbnails and duplicate detection. None of them is network-facing. Plan: one format reader for Matroska and WebM (own implementation of RFC 9559, no third-party code), embedded as an ExtensionKit bundle. Video is decoded by the system decoders (H.264, HEVC, VP9 after VTRegisterSupplementalVideoDecoderIfAvailable, AV1 where available); no own video decoder. Each app calls MTRegisterProfessionalVideoWorkflowFormatReaders() and VTRegisterProfessionalVideoWorkflowVideoDecoders() at launch and shows a notice with a link to System Settings when the extension is disabled (AVErrorMediaExtensionDisabled). Questions: MTProfessionalVideoWorkflow.h and VTProfessionalVideoWorkflow.h say the registration functions are intended for applications supporting professional video workflows. Is it acceptable to call them from apps like these, which serve video editing, review and library management, but not a broadcast or camera workflow? Users may buy only one of the apps, so I'd embed the same format reader (same ClassImplementationID and CFBundleVersion, bundle identifier prefixed by each host app) in every app. Is that supported? When are AVErrorMediaExtensionConflict and kVTExtensionConflictErr returned, and how can they be avoided? Does the enable switch in System Settings apply per ClassImplementationID or per host app? Would a user who installs a second app have to enable the extension again? Is there a supported way to open System Settings directly at General > Login Items & Extensions > Media Extensions from an app? Are there App Review requirements specific to apps that embed Media Extensions, beyond guidelines 2.4.5 and 4.4? Thanks in advance.
Replies
3
Boosts
0
Views
412
Activity
3d
Camera preview rotated 90 degrees on initial presentation on iPadOS 27.2.1, corrected after returning from Control Center
Dear Apple Support Team, We are investigating a camera preview orientation issue on an iPad and would appreciate guidance on the relevant UIKit and AVFoundation behavior. Our app uses Flutter and the third-party Regula Document Reader SDK for passport MRZ scanning. We understand that third-party SDK internals are outside Apple’s support scope. Our question concerns the relationship between the active interface orientation, presentation lifecycle, and camera preview connection orientation. Environment Device: iPad (A16), hardware identifier iPad15,7 iPadOS: 27.2.1, as reported by the device and diagnostic export App distribution: TestFlight App version in the diagnostic log: 2.0.14, build 7 Flutter plugin: flutter_document_reader_api 9.8.1718 Runtime Regula SDK API version: 9.8.6944 Runtime Regula SDK Core version: 9.8.20492 Steps to reproduce Hold the affected iPad in landscape orientation and open the app. Open the passport scanner. The scanner interface appears in landscape, but the camera image appears rotated by 90 degrees. Open Control Center, then dismiss it and return to the app. The preview can then appear in the correct orientation. Close and reopen the scanner; the issue may recur. Physically rotating the device does not consistently resolve the issue. Expected: The preview should match the current interface orientation from initial presentation. Actual: The preview initially has an orientation mismatch and may recover only after leaving and returning to the app. Diagnostic observations We collected initial-entry and app-resume observations within the same scanner session: Before scanner presentation, the active UIWindowScene.interfaceOrientation is landscapeRight. The SDK’s presenting view controller belongs to the active application window. The scanner controller has landscape dimensions of approximately 1180 × 820. The third-party SDK’s supported interface orientation is configured for landscape right. However, the initial preview connection reports videoOrientation = portrait and videoRotationAngle = 90. Updating supported interface orientations and requesting layout updates did not resolve the initial mismatch in this test. A subsequent app-resume observation reports videoOrientation = landscapeRight and videoRotationAngle = 0. This change is recorded before our app’s delayed layout refresh. We recognize that interface orientation and capture rotation are different concepts, and that connection metadata alone does not establish the displayed pixel orientation. We are providing these observations alongside the visible symptom rather than treating a particular angle as universally correct. Scope and investigation status Our separate QR scanner and receipt camera work normally on the same device. The passport scanner also works normally on many other iPads. We have not established that this affects all devices running this iPadOS version. An app-side orientation enum comparison issue was corrected before collecting the build 7 log, but the preview mismatch remained. We have not isolated the cause to iPadOS, our presentation code, or the SDK’s capture initialization. We do not yet have a focused standalone Xcode reproduction project. We are also preparing an inquiry to the SDK vendor. Questions Are there known circumstances in which a camera preview initially uses portrait orientation despite being presented in a landscape UIWindowScene? What is the recommended lifecycle point for determining the initial interface orientation and configuring the preview connection, particularly while presentation or rotation transitions are in progress? Which supported APIs should be used to keep preview rotation synchronized with interface changes on this iPadOS version? Could the recovery after dismissing Control Center indicate an initialization or lifecycle ordering issue? What additional observations would help distinguish these possibilities? What should we include in a minimal native reproduction or system diagnostic collection to make this issue actionable? We can provide a symptom video and an application diagnostic export. These were collected in separate tests on the same affected device and are not time-synchronized. The application export is not an Apple sysdiagnose. Thank you for any guidance on how to investigate this further. With Best Regards, GTF_Japan_Service
Replies
0
Boosts
0
Views
37
Activity
3d
Supported diagnostics for a natural playback transition failure in a WKWebView hosting music.apple.com
We are evaluating an unreleased iPhone app that embeds the complete official music.apple.com page in WKWebView. The official website displays its own lyrics. Our app retains an independent website sign-in and local listening tools. A JavaScript bridge observes playback metadata and provides explicit transport commands through the page's existing MusicKit instance. It does not create a developer-owned MusicKit instance or extract lyrics, credentials, protected audio addresses, or DRM data. On an iPhone 14 Pro Max running iOS 27.2.1, a foreground track can play to its natural end, after which the queue position advances but the next track remains stopped at time zero. A filtered error observation reports MKError with reason NETWORK_ERROR. This identifies the SDK error category, not the underlying cause or request owner. The failure was observed before Safari inspection was attached as well as during inspection. Safari Web Inspector can connect to the app's main page. Our metadata-only observations include a fetch row with HTTP 200 and several subsequent fetch rows with no displayed HTTP status. We have not captured request addresses, headers, cookies, response bodies, HAR files, lyric text, or raw stacks. These rows cannot currently be linked to the SDK error. An earlier actual-zero-user-script control with the full native model and layout completed one foreground transition and continued playing the next track for 51 seconds. This is not a current matched comparison and does not identify a specific bridge operation. The complete bridge can also complete transitions in a separate Mac host. We have no deterministic minimal reproducer establishing an Apple or WebKit defect. The official-website branch leaves Media Session and audio-session ownership to the website and does not issue automatic next-track commands. No proposed global fetch wrapper has been installed, because adding Promise rejection handlers changes observable rejection behavior. We are seeking guidance before expanding instrumentation or requesting more real-device test time. Questions concerning this single transition failure: Is full music.apple.com playback in a third-party WKWebView, alongside observation and explicit transport through the page's existing MusicKit instance, a supported integration pattern? If not, which supported integration preserves a website account independent of the iPhone's Media & Purchases account? Which public diagnostics can distinguish cancellation from transport failure at this transition without exposing protected resource addresses, authorization values, response content, or raw stacks? Are there documented event-listener reentrancy, WKWebView lifecycle, or audio-session constraints that this host should follow when observing the existing player? Environment: iPhone 14 Pro Max; iOS 27.2.1; macOS 27.2.1; Xcode 27.2 (27B52). Experimental app version 0.65, build 67, not submitted. The existing public version is unchanged. Attachments: None. This draft contains no account identifiers, device identifiers, real-session logs, signing material, or source attachments.
Replies
1
Boosts
0
Views
171
Activity
4d
403 / 40300 "Invalid authentication" on every /me request, even with a new key and Media ID
My MusicKit setup worked for about a week, then every request that uses a Music User Token started failing with 403, code 40300, "Invalid authentication". That includes GET /v1/me/storefront. Catalogue requests with the same developer token still work. What I've tried, none of which helped: Signing in again through MusicKit JS (the sign-in itself succeeds) A new MusicKit key, twice A new Media ID with a new key tied to it Accepting the latest program agreements, then signing in again MusicKit JS in Safari gets the same refusal right after sign-in, so it isn't my server code. My Apple Music subscription is active, and I'm signing in with the account that holds it. Has anyone seen user tokens rejected like this and found the cause? I've seen a suggestion that an Apple Account password change can trigger it, but nothing about how to recover. Feedback filed as FB25575398
Replies
1
Boosts
0
Views
342
Activity
4d
Let Audio Units read the project's whole tempo and signature map (FB25609451)
I've filed FB25609451 and I'm posting it here so other Audio Unit developers can add their own feedback if they need the same. What I'd love in Logic Pro (and any AU host) is what REAPER already does for plug-ins: you insert the plug-in and it immediately knows the whole song, every bar's time signature and tempo, without playing anything, and it updates right away when you change a signature or tempo. In REAPER this works through its host interface (IReaperHostApplication): the plug-in calls TimeMap_GetMeasureInfo to read the start, time signature and tempo of any bar. For Audio Units today, HostCallback_GetBeatAndTempo / HostCallback_GetMusicalTimeLocation (AUv2) and musicalContextBlock / transportStateBlock (AUv3) give the current tempo and time signature, but nothing about the other bars. So a time-aware plug-in has to hear the song played through once, or the user pastes the Signature List into it and redoes it after every edit. Suggestion, read-only: A way for an Audio Unit to read the project's tempo and signature map (Signature track and Tempo track), for example a host callback for AUv2 and a block or property on AUAudioUnit for AUv3, returning every event with its position, time signature and tempo. A notification when the user edits them. Also useful: the current bar number in musicalContextBlock / HostCallback_GetMusicalTimeLocation, and the playback rate during Varispeed. It would help click and count-in tools, arpeggiators and sequencers, tempo-synced effects, and notation or visual displays. If you need this too, filing your own feedback that mentions FB25609451 helps. Leo Margarit, Margarit Audio (OddClick)
Replies
0
Boosts
0
Views
49
Activity
5d
Is Apple Music artwork allowed in a music discovery app without playback?
Hi Apple Developer Community, I'm developing an iOS app focused on music discovery and social interaction. Users can share songs with people nearby, and I'd like to use the Apple Music API to retrieve song metadata and album artwork. The artwork would appear on map markers, shared song cards, and user music profiles. The app is not primarily a music player, and users would be able to open songs in Apple Music. I'd like to clarify: Is this use of Apple Music metadata and album artwork permitted under the MusicKit / Apple Music API terms, even without in-app music playback? Would displaying artwork in these social discovery contexts require additional licensing or permission? If additional permission is needed, which official Apple team or licensing channel should I contact? I want to ensure the app complies with Apple's terms before release. Thank you for your guidance!
Replies
0
Boosts
0
Views
170
Activity
5d
MusicKitJS | Cannot play explicit songs | CONTENT_RESTRICTED
[Ticket on Feedback Assistant FB12353357] Hi there, We’re experiencing issues playing explicit songs using MusicKitJS for the Web (tested on both stable v1 and beta v3). Upon calling the SDK’s “play()” function, the following error gets logged in the console “CONTENT_RESTRICTED: Content restricted” and playback doesn’t begin. The Storefront we’ve tested in is “it”, but very likely all of them are impacted with the issue, here’s a few Adam IDs of affected tracks: 1681182396, 1683117248, 1669607876. A quick check with the REST APIs reveals indeed that the relevant thing all 3 of them have in common is "contentRating" being "explicit”. The bug isn’t however easy or predictable to replicate because it seems that it can be somewhat solved by fiddling with both the “Screen Time” restrictions settings within an iOS/iPadOS device (of course logged in with the same Apple account), as well as with the “Parental Controls” dashboard located in the Web version of the Apple Music’s settings page. We’re still not 100% sure what exactly “triggers” the fix, but both mentioned dashboards above are essential in attempting to solve it by trial and error. Specifically: in the “Parental Controls” dashboard what helps is actually turning ON the restrictions with the toggle, and then easing them up the most by specifically setting the less restricted available option in all 3 dropdown menus (pretty baffling); in the “Screen time” dashboard what helps is simply enabling/disabling the feature itself altogether, as well as the “Content & Privacy restrictions” toggle, and changing the level of allowed content between “Clean” and “Explicit”; I also want to highlight the fact that during the entire process, for the issue to be actually solved, users every time had to to restart their iPhone/iPad multiple times after changing a setting in “Screen time”, along with deauthorizing/authorizing (logging out and back in) their Apple Music account from the MusicKitJS SDK. The issue seems to always affect freshly created Apple accounts right from the start, we’re not aware of methods that can lead to the bug “coming back” and starting to happen again after being solved manually with the process above (meddling “randomly” with dashboards). It’s a pretty serious one because many of our users do not posses an Apple device and only use their Apple Music subscription on the Web and/or their Android device, meaning that the “Screen time” dashboard isn’t available for them. We’ve never been able to solve the problem on an Apple ID account solely by fiddling with the “Parental Controls” dashboard located in the Web version of the Apple Music’s settings page: tinkering with the “Screen time” settings was essential every single time, meaning owning an Apple device is essential to solve it. Last thing I’m adding is that the issue doesn’t seem to also affect listening to these explicit songs directly with the various first-party Apple Music clients (tested on the iOS native app, Android native app, and on the Apple Music WebApp). Steps to reproduce: on the Web, create a new Apple ID account and activate an Apple Music subscription (do not login with said account on an Apple device); go to the Apple Music WebApp settings page at music.apple.com/account/settings and make sure that the “Parental Controls” restrictions are turned OFF; open any explicit song in the Apple Music WebApp and confirm that playback is allowed; login and authorize the newly created account using any website/application integrated with the MusicKitJS SDK (v1 or v3, doesn’t matter); open the same explicit song as before (or any other) in said third-party client that uses the SDK and verify that playback doesn’t begin and an error “CONTENT_RESTRICTED: Content restricted” is logged in the console upon playing. Additional infos: Apple ID account region and language: Italy - Italian; Storefront affected: IT but possibly all of them; MusicKitJS versions affected: both v1 and v3; Browser where the issue was reproduced: Chrome v114. Attached you’ll find some informational screenshots. Thanks!
Replies
3
Boosts
0
Views
2.1k
Activity
5d
iOS ScreenCaptureKit: background frame processing and capture scope
I’m evaluating ScreenCaptureKit for an explicitly user-initiated, on-device text-recognition workflow on iPhone. Apple’s “Capturing screen content on iOS” sample currently describes iOS 27 full-display capture and capture continuing while the app is backgrounded. Before building a minimal prototype, I’d like to clarify: Can screen frames continue to be delivered and processed locally using Vision for text recognition while another app is foregrounded? What background configuration and processing limitations apply? Can capture on iPhone be restricted to a specific third-party app, or are the available scopes full-display capture and the capturing app’s own content? Is there a supported way to detect that the user has left the intended capture source and stop capture? Are there documented restrictions on capturing system apps, particularly Messages? The intended configuration has explicit system authorization, a visible capture indication, stop/cancel controls, no audio or camera capture, no network transmission, and no retained screen recording. Temporary recognition results would expire and be discarded; only explicitly user-selected output would be retained. This is a capability investigation, not a report of an observed failure. I haven’t run a device prototype yet.
Replies
0
Boosts
0
Views
142
Activity
5d
Mouse/Window Lag 4K Display
Hi, all! I recently redid my set up and bought a 44" 4K Samsung TV to mirror the display on my Macbook air. I connected everything using a Hyper Display HDMI hub. Everything is connecting ok, but I'm noticing that there is a slight lag in my mouse and display. The refresh rate is set to 60 and my display is set to 1920x1080. I've tried looking up everything and have had no luck. Any help would be appreciated!
Replies
0
Boosts
0
Views
31
Activity
5d
AUHAL input callback teardown: when is inputProcRefCon safe to release?
I am developing a macOS application that captures audio through an AUHAL input AudioUnit. The application registers an input callback using kAudioOutputUnitProperty_SetInputCallback. The callback receives an application-owned context through inputProcRefCon and obtains input audio using AudioUnitRender. The intended shutdown sequence is: Close application-level callback admission. Call AudioOutputUnitStop. Remove the callback using AudioUnitSetProperty with a zero-initialized AURenderCallbackStruct. Wait for callbacks already entered by the application to finish. Call AudioUnitUninitialize and AudioComponentInstanceDispose. Release the application-owned callback context. We use an atomic active-callback counter, covering all context accesses made by callbacks that have entered the counted region. However, this counter cannot account for a callback that Core Audio may have already dispatched but that has not yet executed its first instruction. My question: Is there a supported AUHAL teardown sequence that guarantees no previously scheduled, dispatched, or executing input callback can subsequently access inputProcRefCon? Specifically, does successful return from AudioOutputUnitStop, callback removal, AudioUnitUninitialize, or AudioComponentInstanceDispose provide such a guarantee? Is passing an AURenderCallbackStruct with both fields set to NULL a supported way to remove the input callback, and does removal have any documented completion semantics? If none of these operations provides the required guarantee independently, what is the recommended lifetime-management pattern for safely releasing the application-owned callback context? I have prepared a small standalone AUHAL test project that compiles the relevant Core Audio operations and passes deterministic offline lifecycle tests. Physical AUHAL activation and native callback teardown have not yet been executed, so I am not claiming a reproduced crash or verified native behavior. I am primarily seeking clarification of the supported Core Audio API contract, rather than a diagnosis of an observed crash. Thank you.
Replies
0
Boosts
0
Views
104
Activity
6d