Loon
Android | iOS | Web | macOS |
---|---|---|---|
✅ | ✅ | ✅ | ✅ |
Loon is a reactive document data store for Flutter.
Features
- Synchronous reading, writing and querying of documents.
- Streaming of changes to documents and queries.
- Out of the box persistence and encryption.
You can get started by looking at the example.
Install
flutter pub add loon
➕ Creating documents
Loon makes it easy to work with collections of documents.
import 'package:loon/loon.dart';
Loon.collection('users').doc('1').create({
'name': 'John',
'age': 28,
});
Documents are stored under collections in a tree structure. They can contain any type of data, like a String
, Map
or typed data model:
import 'package:loon/loon.dart';
import './models/user.dart';
Loon.collection<UserModel>(
'users',
fromJson: UserModel.fromJson,
toJson: (user) => user.toJson(),
).doc('1').create(
UserModel(
name: 'John',
age: 28,
)
);
If persistence is enabled, then a typed collection needs to specify a fromJson/toJson
serialization pair. In order to avoid having to specify types or serializers whenever a collection is accessed, it can be helpful to store the collection in a variable or as an index on the data model:
class UserModel {
final String name;
final int age;
UserModel({
required this.name,
required this.age,
});
static final Collection<UserModel> store = Loon.collection(
'users',
fromJson: UserModel.fromJson,
toJson: (user) => user.toJson(),
);
}
Documents can then be read/written using the index:
UserModel.store.doc('1').create(
UserModel(
name: 'John',
age: 28,
),
);
📚 Reading documents
final snap = UserModel.store.doc('1').get();
if (snap != null && snap.data.name == 'John') {
print('Hi John!');
}
Reading a document returns a DocumentSnapshot?
which exposes a document's data and ID:
print(snap.id) // 1
print(snap.data) // UserModel(...)
To watch for changes to a document, you can listen to its stream:
UserModel.store.doc('1').stream().listen((snap) {});
You can then use Flutter's built-in StreamBuilder
or the library's DocumentStreamBuilder
widget to access data from widgets:
class MyWidget extends StatelessWidget {
@override
build(context) {
return DocumentStreamBuilder(
doc: UserModel.store.doc('1'),
builder: (context, snap) {
final user = snap?.data;
if (user == null) {
return Text('Missing user');
}
return Text('Found user ${user.name}');
}
)
}
}
𖢞 Subcollections
Documents can be nested under subcollections. Documents in subcollections are uniquely identified by the path to their collection and their document ID.
final friendsCollection = UserModel.store.doc('1').subcollection('friends');
friendsCollection.doc('2').create(UserModel(name: 'Jack', age: 17));
friendsCollection.doc('3').create(UserModel(name: 'Brenda', age: 40));
friendsCollection.doc('4').create(UserModel(name: 'Bill', age: 70));
final snaps = friendsCollection.get();
for (final snap in snaps) {
print("${snap.data.name}: ${snap.path}");
// Jack: users__1__friends__2
// Brenda: users__1__friends__3
// Bill: users__1__friends__4
}
🔎 Queries
Documents can be filtered using queries:
final snapshots = friendsCollection.where((snap) => snap.data.name.startsWith('B')).get();
for (final snap in snapshots) {
print(snap.data.name);
// Brenda
// Bill
}
Queries can also be streamed, optionally using the QueryStreamBuilder
:
class MyWidget extends StatelessWidget {
@override
build(context) {
return QueryStreamBuilder(
query: UserModel.store.where((snap) => snap.data.age >= 18),
builder: (context, snaps) {
return ListView.builder(
itemCount: snaps.length,
builder: (context, snap) {
return Text('${snap.data.name} is old enough to vote!');
}
)
}
)
}
}
✏️ Updating documents
Assuming a model has a copyWith
function, documents can be updated as shown below:
final doc = UserModel.store.doc('1');
final snap = doc.get();
doc.update(snap.data.copyWith(name: 'John Smith'));
The reading and writing of a document can be combined using the modify
API. If the document does not yet exist, then its snapshot is null
.
UserModel.store.doc('1').modify((snap) {
return snap?.data.copyWith(name: 'John Smitherson');
});
❌ Deleting documents
Deleting a document removes it and all of its subcollections from the store.
UserModel.store.doc('1').delete();
🌊 Streaming changes
Documents and queries can be streamed for changes which provides the previous and current document data as well as the event type of the change:
UserModel.store.streamChanges().listen((changes) {
for (final changeSnap in changes) {
switch(changeSnap.event) {
case BroadcastEvents.added:
print('New document ${changeSnap.id} was added to the collection.');
break;
case BroadcastEvents.modified:
print('The document ${changeSnap.id} was modified from ${changeSnap.prevData} to ${changeSnap.data}.');
break;
case BroadcastEvents.removed:
print('${changeSnap.id} was removed from the collection.');
break;
case BroadcastEvents.hydrated:
print('${changeSnap.id} was hydrated from the persisted data.');
break;
}
}
});
🔁 Data Dependencies
Data relationships in the store can be established using the data dependencies builder.
class PostModel {
final String message;
final String userId;
PostModel({
required this.message,
required this.userId,
})
}
final posts = Loon.collection<PostModel>(
'posts',
dependenciesBuilder: (snap) {
return {
UserModel.store.doc(snap.data.userId),
};
},
);
In this example, whenever a post's associated user is updated, the post will also be rebroadcast to its active listeners.
Additionally, whenever a document is updated, it will rebuild its set of dependencies, allowing documents to support dynamic dependencies that can change in response to updated document data.
🪴 Root collection
Not all documents necessarily make sense to be grouped together under any particular collection. In this scenario, any one-off documents can be stored on the root collection:
Loon.doc('current_user_id').create('1');
🗄️ Data Persistence
Persistence is supported on both web and native platforms. It works out of the box and can be configured on app start.
Native platforms (iOS, Android, macOS) use a default file-based persistence implementation, while web persists data to IndexedDB.
The currently available persistence options are broken down by platform:
Native
- SqlitePersistor: A SQLite persistence implementation using sqflite. Documents are distributed in rows based on their persistence configuration.
- FilePersistor: A file-based persistence implementation for native platforms. Documents are stored in one or more files based on the persistence configuration.
Web
- IndexedDBPersistor: The default persistence implementation for web platforms. Documents are stored in IndexedDB, a low-level API for web-based client-side storage.
-
Note: Encryption on web is experimental through flutter_secure_storage. It is important to enable the correct headers in order to ensure security of encryption on web.
-
⚙️ Configuration
A persistor can be specified explicitly on startup, or Persistor.current()
can be used to dynamically select the default persistence implementation for the current platform.
void main() {
Loon.configure(persistor: Persistor.current());
Loon.hydrate().then(() {
print('Hydration complete');
});
runApp(const MyApp());
}
The call to hydrate
returns a Future
that resolves when the data has been hydrated from the persistence layer. By default, calling hydrate()
will hydrate all persisted data. If only certain data should be hydrated, then it can be called with a list of documents and collections to hydrate. All subcollections of the specified paths are also hydrated.
await Loon.hydrate([
Loon.doc('current_user_id'),
Loon.collection('users'),
]);
⚙️ Dynamic options
Persistence options can be specified both globally as well as on a per-collection basis.
// main.dart
void main() {
// Globally enable encryption.
Loon.configure(persistor: FilePersistor(settings: PersistorSettings(encrypted: true));
Loon.hydrate().then(() {
print('Hydration complete');
});
}
// models/user.dart
class UserModel {
final String name;
final int age;
UserModel({
required this.name,
required this.age,
});
static Collection<UserModel> get store {
return Loon.collection(
'users',
fromJson: UserModel.fromJson,
toJson: (user) => user.toJson(),
// Disable encryption specifically for this collection and its subcollections.
settings: PersistorSettings(encrypted: false),
)
}
}
In this example, file encryption is enabled globally for all collections, but disabled specifically for the users collection and its subcollections in the store.
By default all data in a single __store__.json
persistence file.
loon >
__store__.json
If data needs to be persisted differently, either by merging data across collections into a single file or by breaking down a collection into multiple files, then a custom persistence key can be specified on the collection:
class UserModel {
final String name;
final int age;
UserModel({
required this.name,
required this.age,
});
static Collection<UserModel> get store {
return Loon.collection(
'users',
fromJson: UserModel.fromJson,
toJson: (user) => user.toJson(),
settings: PersistorSettings(
key: Persistor.key('users'),
),
)
}
}
In the updated example, data from the users collection is now stored in a separate file:
loon >
__store__.json
users.json
If documents need to be stored in different files based on their data, then a Persistor.keyBuilder
can be used:
class UserModel {
final String name;
final int age;
UserModel({
required this.name,
required this.age,
});
static Collection<UserModel> get store {
return Loon.collection(
'users',
fromJson: UserModel.fromJson,
toJson: (user) => user.toJson(),
settings: PersistorSettings(
key: Persistor.keyBuilder((snap) {
if (snap.data.age >= 18) {
return 'adult_users';
}
return 'users';
}),
),
)
}
}
loon >
__store__.json
users.json
adult_users.json
Now instead of storing all users in the users.json
file, they will be distributed across multiple files based on the user's age. The key is recalculated
whenever a document's data changes and if its associated key is updated, then the document is moved from its previous file to its updated location.
🎨 Custom persistence
If you would prefer to persist data using an alternative implementation than the default persistors, you can implement the persistence interface:
import 'package:loon/loon.dart';
class MyPersistor extends Persistor {
/// Initialization function called when the persistor is instantiated to execute and setup work.
Future<void> init();
/// Persist function called with the bath of documents that have changed (including been deleted) within the last throttle window
/// specified by the [Persistor.persistenceThrottle] duration.
Future<void> persist(Set<Document> docs);
/// Hydration function called to read data from persistence. If no entities are specified,
/// then it hydrations all persisted data. if entities are specified, it hydrates only the data from
/// the paths under those entities.
Future<Json> hydrate([Set<StoreReference>? refs]);
/// Clear function used to clear all documents under the given collections.
Future<void> clear(Set<Collection> collections);
/// Clears all documents and removes all persisted data.
Future<void> clearAll();
}
Extensions
- Firestore: The loon_extension_firestore package is used to sync documents fetched from Firestore into Loon.
Documents
- Architecture: An architecture doc that breaks down the inner workings of the library.
- Debugging: A debugging doc that calls out any known issues or troubleshooting suggestions across different platforms.
Happy coding
That's all for now! Want a feature? Found a bug? Create an issue!
Libraries
- loon
- persistor/data_store
- persistor/data_store_encrypter
- persistor/data_store_manager
- persistor/data_store_resolver
- persistor/file_persistor/file_data_store_config
- persistor/file_persistor/file_persistor
- persistor/file_persistor/file_persistor_worker
- persistor/indexed_db_persistor/indexed_db_data_store_config
- persistor/indexed_db_persistor/indexed_db_persistor
- persistor/indexed_db_persistor/stub_indexed_db_persistor
- persistor/indexed_db_persistor/web_indexed_db_persistor
- persistor/lock
- persistor/persist_payload
- persistor/persistence_document
- persistor/sqlite_persistor/sqlite_data_store_config
- persistor/sqlite_persistor/sqlite_persistor
- persistor/sqlite_persistor/sqlite_persistor_worker
- persistor/worker/messages
- persistor/worker/persistor_worker
- persistor/worker/persistor_worker_messenger
- persistor/worker/persistor_worker_mixin
- widgets/document_stream_builder
- widgets/query_stream_builder