Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DRAFT] Vertexai/bidi #16991

Draft
wants to merge 13 commits into
base: main
Choose a base branch
from
+1,343 −10
Draft

[DRAFT] Vertexai/bidi #16991

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f53b00c
init
cynthiajoan Jan 13, 2025
0e5a21d
more testing for the audio player
cynthiajoan Jan 20, 2025
cd59d74
organize example page and functions
cynthiajoan Jan 23, 2025
8b3285d
Merge branch 'vertexai/example_update' into vertexai/bidi
cynthiajoan Jan 23, 2025
c5bb860
get bidi demo working under new example layout
cynthiajoan Jan 23, 2025
9575c5e
Merge branch 'main' into vertexai/bidi
cynthiajoan Jan 27, 2025
3ff550e
kinda playable
cynthiajoan Jan 28, 2025
d2cbaff
working audio output
cynthiajoan Jan 29, 2025
76aa22b
use firebase project for the connection
cynthiajoan Jan 30, 2025
c1695e5
record to file and load file to stream, no response yet
cynthiajoan Feb 3, 2025
b361009
try different ways to test sending audio
cynthiajoan Feb 3, 2025
9988f72
try realtime input
cynthiajoan Feb 6, 2025
2d37054
Merge branch 'main' into vertexai/bidi
cynthiajoan Feb 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion packages/firebase_vertexai/firebase_vertexai/example/ios/Runner/AppDelegate.swift
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
import UIKit
import Flutter

@UIApplicationMain
@main
@objc class AppDelegate: FlutterAppDelegate {
override func application(
_ application: UIApplication,
Expand Down
14 changes: 12 additions & 2 deletions packages/firebase_vertexai/firebase_vertexai/example/lib/main.dart
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,14 +23,15 @@ import 'pages/image_prompt_page.dart';
import 'pages/token_count_page.dart';
import 'pages/schema_page.dart';
import 'pages/storage_uri_page.dart';
import 'pages/bidi_page.dart';

// REQUIRED if you want to run on Web
const FirebaseOptions? options = null;

void main() async {
WidgetsFlutterBinding.ensureInitialized();
await Firebase.initializeApp();
await FirebaseAuth.instance.signInAnonymously();
await Firebase.initializeApp(options: options);
// await FirebaseAuth.instance.signInAnonymously();

var vertex_instance =
FirebaseVertexAI.instanceFor(auth: FirebaseAuth.instance);
Expand Down Expand Up @@ -81,6 +82,7 @@ class _HomeScreenState extends State<HomeScreen> {
ImagePromptPage(title: 'Image Prompt', model: widget.model),
StorageUriPromptPage(title: 'Storage URI Prompt', model: widget.model),
SchemaPromptPage(title: 'Schema Prompt', model: widget.model),
BidiPage(title: 'Bidi Stream', model: widget.model),
];

void _onItemTapped(int index) {
Expand Down Expand Up @@ -148,6 +150,14 @@ class _HomeScreenState extends State<HomeScreen> {
label: 'Schema Prompt',
tooltip: 'Schema Prompt',
),
BottomNavigationBarItem(
icon: Icon(
Icons.stream,
color: Theme.of(context).colorScheme.primary,
),
label: 'Bidi Stream',
tooltip: 'Bidi Stream',
),
],
currentIndex: _selectedIndex,
onTap: _onItemTapped,
Expand Down
Loading
Loading