Highlights
- Tensor Silicon & Thermals: Live CPU core frequencies, GPU clock/load, ADPF thermal headroom hints, and Perfetto system tracing.
- On-Device Edge AI: Run Gemini Nano locally via AICore, generate on-device text embeddings from a TFLite embedder model you supply (MediaPipe TextEmbedder on CPU; unavailable until the model file is present), perform offline translation (58 languages), and run ML Kit vision tasks with zero server dependencies.
- Cloud AI & Gemini Live Duplex: Stream bidirectional voice and text over WebSockets in real time (
useGeminiLive), query autonomous hardware diagnostic agents, and deploy ADK multi-agent triage teams.
- Modern Sensors & Acoustics: Directional 3-microphone beamforming arrays, non-contact MLX90632 FIR thermometer, and ICAO barometric altimeter with climb rates.
- Next-Gen Radios & Security: Wi-Fi 7 Multi-Link Operation (MLO), 802.11mc/az Wi-Fi RTT sub-meter indoor ranging, Satellite NTN states, Android 15 Private Space isolation, and Titan M2 StrongBox ECDH key agreement.
- Hardware Actuators: Camera-bar HiLight LED sequences, custom LRA haptics, torch control, and reverse wireless Qi battery power sharing.
Quickstart
# Core SDK: silicon telemetry, sensors, radios, security, actuators, cloud AI
npx expo install @pixelkit-labs/sdk @pixelkit-labs/native
# On-device Edge AI: Gemini Nano, ML Kit vision & translation, local embeddings (opt-in)
npx expo install @pixelkit-labs/mlkit
Example: Hardware Monitoring & Edge AI
import React from 'react';
import { View, Text, Button } from 'react-native';
import { useCPU, useADPF } from '@pixelkit-labs/sdk';
import { useGeminiNano } from '@pixelkit-labs/sdk/mlkit';
export function HardwareTelemetryScreen() {
const cpu = useCPU();
const { thermalHeadroom, thermalStatus } = useADPF();
const { isAvailable, generateText } = useGeminiNano();
const runOnDeviceAnalysis = async () => {
const prompt = `CPU Frequency: ${cpu.cores[0]?.curMHz} MHz. Thermal Status: ${thermalStatus}. Provide hardware advice.`;
const response = await generateText(prompt);
console.log('Gemini Nano analysis:', response);
};
return (
<View style={{ padding: 16 }}>
<Text>CPU Core 0: {cpu.cores[0]?.curMHz ?? '—'} MHz</Text>
<Text>Thermal Headroom: {thermalHeadroom?.toFixed(2) ?? '—'}</Text>
<Button
title="Analyze with Gemini Nano"
disabled={!isAvailable}
onPress={runOnDeviceAnalysis}
/>
</View>
);
}
Hooks (53 Total)
Every hook is typed, observed, and tested across real hardware:
Silicon & System
useCPU · useGPU · useSystemLoad · useTPU · useMemory · useADPF · useADPFHintSession · useBatteryShare · useChargingIntelligence · usePerfetto · useDevice · useDisplay · useNetwork · useCellular · useCapabilities
Sensors & Capture
useSensors · useAltimeter · useThermometer · useLocation · useCamera · useCameraExtensions · useVideo · useMediaLibrary · useAudio · useMicrophoneArray · useSpatialAudio · useHealthConnect
Actuators
useHaptics · useTorch · useHiLight
Radios & Wireless
useBLE · useChannelSounding · useNFC · useUWB · useRadios · useWifi7MLO · useWifiRTT · useSatelliteNTN
Security & Privacy
useBiometrics · useSecurity · useKeyAgreement · usePrivateSpace · usePlayIntegrity
AI & Autonomous Agents (Cloud & Live Duplex)
useGemini · useCloudHardwareAgent · useGeminiLive · useSpeechAI · useSpeech · useAppFunctions
useSpeech keeps platform TTS, explicit Android TTS and Gemini Live audio as distinct output identities. For an explicit enginePackage, PixelKit inventories and rechecks the installed package/version, resolves the exact active package and selected voice/locale, and rejects missing, changed, mismatched or unobservable engines before synthesis. resolveSpeechEngineIdentity() performs preflight and verifySpeechEngine() records a caller-supplied verification phrase with correlated start/terminal callbacks. External apps still own their model downloads, their internal execution provider remains unknown, and callbacks do not prove audible voice identity.
Cloud, Live, ADK, Nano, speech-recognition and TTS runs use explicit application-owned trace context. Build an immutable capability adapter with createCapabilityAdapter() (or createUnavailableCapabilityAdapter()), create the root with createTraceContext(), and pass both into the run API. Effect capabilities cannot execute without the adapter's authorizeEffect policy callback; empty or unavailable adapters fail before model contact.
Gemini credentials persist through native SecureStore only. getStoredApiKey(), saveApiKey() and removeApiKey() verify canonical storage state and migrate the legacy slot transactionally. Persistent browser credential storage is intentionally unavailable; browser callers must provide credentials ephemerally to APIs that accept them.
On-Device AI (@pixelkit-labs/sdk/mlkit)
useGeminiNano · useGenAITasks · useVisionAI · useNaturalLanguageAI · useEmbeddings
Technical Features
Typed Hardware Provenance
Every telemetry hook exposes source: 'hardware' | 'derived' | 'unavailable'. When a specific sensor or hardware feature is absent or unreadable on a device, the hook returns clean null values and reports unavailable. This gives applications deterministic typing and avoids fabricated dummy values.
Observability on Every Call
Calls touching hardware, native modules, or filesystem are instrumented with traced(). Use useObservability() or the <PixelKitDevTools /> in-app HUD to inspect live trace latencies, error distributions, and module health.
Requirements & Compatibility
| Specification | Requirement |
|---|
| Platform | Android 14+ (API 34+), optimized for Tensor G5/G6 & Android 17 (API 37) |
| Framework | React Native 0.86+, Expo SDK ~57.0+ |
| Build | Expo Development Build (npx expo run:android) or EAS Build |
| Hardware | Google Pixel 11 Pro, Pro XL, Pro Fold, and Pixel 8/9/10/11 series |
PixelKit requires an Expo development build because it compiles Kotlin modules directly into your app. 15 hooks are pure JavaScript/Expo APIs and function on any Android device; native silicon and hardware hooks gracefully degrade with source: 'unavailable' on non-supported devices.
Use the CLI doctor to verify your environment:
npx @pixelkit-labs/cli doctor
Ecosystem Repositories
- pixelkit-template: Complete four-tab demo app demonstrating the hooks, live AI lab, and camera/sensor visualizers.
- pixelkit-docs: Full API reference, contracts, and interactive documentation site.
- pixelkit-cli: Command-line diagnostics (
pixelkit doctor) and autonomous hardware triage agent (pixelkit agent).
License
MIT © PixelKit Labs
