Firestore Data Migration

Supabase provides several tools to convert data from a Firebase Firestore database to a Supabase PostgreSQL database. The process copies the entire contents of a single Firestore collection to a single PostgreSQL table.

The Firestore collection is "flattened" and converted to a table with basic columns of one of the following types: text, numeric, boolean, or jsonb. If your structure is more complex, you can write a program to split the newly-created json file into multiple, related tables before you import your json file(s) to Supabase.

Set up the migration tool #

1. Clone the firebase-to-supabase repository:

1. In the /firestore directory, create a file named supabase-service.json with the following contents:

1. Go to the Database settings for your project in the Supabase Dashboard.
2. Under Connection parameters, enable Use connection pooling and set the mode to Session. Replace the Host and User fields with the values shown.
3. Enter the password you used when you created your Supabase project in the password entry in the supabase-service.json file.

Generate a Firebase private key #

1. Log in to your Firebase Console and open your project.
2. Click the gear icon next to Project Overview in the sidebar and select Project Settings.
3. Click Service Accounts and select Firebase Admin SDK.
4. Click Generate new private key.
5. Rename the downloaded file to firebase-service.json.

Command line options#

List all Firestore collections#

node collections.js

Dump Firestore collection to JSON file#

node firestore2json.js <collectionName> [<batchSize>] [<limit>]

• batchSize (optional) defaults to 1000
• output filename is <collectionName>.json
• limit (optional) defaults to 0 (no limit)

Customize the JSON file with hooks#

You can customize the way your JSON file is written using a custom hook. A common use for this is to "flatten" the JSON file, or to split nested data into separate, related database tables. For example, you could take a Firestore document that looks like this:

And split it into two files (one table for users and one table for items):

Import JSON file to Supabase (PostgreSQL) #

node json2supabase.js <path_to_json_file> [<primary_key_strategy>] [<primary_key_name>]

• <path_to_json_file> The full path of the file you created in the previous step (Dump Firestore collection to JSON file ), such as ./my_collection.json
• [<primary_key_strategy>] (optional) Is one of:
  • none (default) No primary key is added to the table.
  • smallserial Creates a key using (id SMALLSERIAL PRIMARY KEY) (autoincrementing 2-byte integer).
  • serial Creates a key using (id SERIAL PRIMARY KEY) (autoincrementing 4-byte integer).
  • bigserial Creates a key using (id BIGSERIAL PRIMARY KEY) (autoincrementing 8-byte integer).
  • uuid Creates a key using (id UUID PRIMARY KEY DEFAULT gen_random_uuid()) (randomly generated UUID).
  • firestore_id Creates a key using (id TEXT PRIMARY KEY) (uses existing firestore_id random text as key).
• [<primary_key_name>] (optional) Name of primary key. Defaults to "id".

Custom hooks#

Hooks are used to customize the process of exporting a collection of Firestore documents to JSON. They can be used for:

• Customizing or modifying keys
• Calculating data
• Flattening nested documents into related SQL tables

Write a custom hook#

Create a .js file for your collection#

If your Firestore collection is called users, create a file called users.js in the current folder.

Construct your .js file#

The basic format of a hook file looks like this:

Parameters

• collectionName: The name of the collection you are processing.
• doc: The current document (JSON object) being processed.
• recordCounters: An internal object that keeps track of how many records have been processed in each collection.
• writeRecord: This function automatically handles the process of writing data to other JSON files (useful for "flatting" your document into separate JSON files to be written to separate database tables). writeRecord takes the following parameters:
  • name: Name of the JSON file to write to.
  • doc: The document to write to the file.
  • recordCounters: The same recordCounters object that was passed to this hook (just passes it on).

Examples#

Add a new (unique) numeric key to a collection#

Add a timestamp of when this record was dumped from Firestore#

Flatten JSON into separate files#

Flatten the users collection into separate files:

The users.js hook file:

The result is two separate JSON files:

Resources#

• Supabase vs Firebase
• Firestore Storage Migration
• Firebase Auth Migration