Skip to content

Latest commit

 

History

History
915 lines (674 loc) · 50.5 KB

README.md

File metadata and controls

915 lines (674 loc) · 50.5 KB

Cordova/PhoneGap sqlite storage with extras

Native interface to sqlite in a Cordova/PhoneGap plugin for Android, iOS, Windows "Universal" (8.1), Amazon Fire-OS, and WP(7/8) with API similar to HTML5/Web SQL API.

License for Android, Windows "Universal" (8.1), Amazon Fire-OS, and WP(7/8) versions: MIT or Apache 2.0

License for iOS version: MIT only

Android CI (full limited suite) iOS CI (limited suite)
Circle CI Build Status

NOTICE: Changes to free support

Effective November 3, 2015 free support will only be provided on Tuesdays from 12:00 to 16:00 GMT, according to the procedure described in the support section below.

Commercial support is available by contacting: [email protected]

IMPORTANT: iCloud backup of SQLite database is NOT allowed

As documented in the "A User’s iCloud Storage Is Limited" section of iCloudFundamentals in Mac Developer Library iCloud Design Guide (near the beginning):

  • DO store the following in iCloud:
    • [other items omitted]
    • Change log files for a SQLite database (a SQLite database’s store file must never be stored in iCloud)
  • DO NOT store the following in iCloud:
    • [items omitted]
- iCloudFundamentals in Mac Developer Library iCloud Design Guide

More information about iCloud backup

There are two ways iCloud backup is configured:

  • For each app, iCloud backup is configured in config.xml and is enabled by default (which I think is wrong) as documented at: https://cordova.apache.org/docs/en/5.1.1/guide/platforms/ios/config.html
  • In this plugin, the database is stored in the Documents subdirectory by default, which is backed up to iCloud. You can use the location option in sqlitePlugin.openDatabase() to store the database in a subdirectory that is NOT backed up to iCloud.

Unless you want your app to use iCloud backup for some reason, it is recommended to turn it off as documented in: https://cordova.apache.org/docs/en/5.1.1/guide/platforms/ios/config.html

I raised Cordova bug CB-9830 to disable iCloud backup by default in config.xml.

Available for hire

The primary author and maintainer @brodybits (Chris Brody) is available for contracting assignments. Part-time contracting assignments would really help keep this project alive. @brodybits (Chris Brody) can be contacted at: [email protected]

LinkedIn: https://www.linkedin.com/in/chrisbrody

PhoneGap developer page: http://people.phonegap.com/developer/chris-brody

Other projects:

  • brodybits / node-uvhttp - HTTP server library that serves static content from native code - under development and currently extremely limited
  • brodybits / java-node - two-way binding interface between Java and Node.js (Javascript) - under development and currently extremely limited

Status

  • Windows "Universal" for Windows 8.0/8.1(+) and Windows Phone 8.1(+) version is in an alpha state:
    • Issue with UNICODE \u0000 character (same as \0)
    • No background processing (for future consideration)
    • You may encounter issues with Cordova CLI due to CB-8866; as a workaround you can install using litehelpers / cordova-windows-nufix and plugman as described below.
    • In addition, problems with the Windows "Universal" version have been reported in case of a Cordova project using a Visual Studio template/extension instead of Cordova/PhoneGap CLI or plugman
    • Not tested with a Windows 10 (or Windows Phone 10) target; Windows 10 build is not expected to work with Windows Phone
  • FTS3, FTS4, and R-Tree support is tested working OK in this version (for target platforms Android/iOS/Windows "Universal")
  • Status for the other target platforms:
    • Android: now using Android-sqlite-connector (with sqlite 3.7.17), with support for FTS3/FTS4 and R-Tree, and REGEXP support using PCRE 8.37 as built from brodybits / Android-sqlite-native-driver-pcre-regexp
    • iOS: sqlite 3.8.10.2 embedded
    • WP7: possible to build from C#, as specified by plugin.xml - NOT TESTED
    • WP8: performance/stability issues have been reported with the CSharp-SQLite library. Windows ("Universal") platform is recommended for the future. FTS3/FTS4/R-Tree are NOT supported for WP(7/8).
  • Android is supported back to SDK 10 (a.k.a. Gingerbread, Android 2.3.3); support for older versions is available upon request.
  • API to open the database may be changed somewhat to be more streamlined. Transaction and single-statement query API will NOT be changed.
  • In case of memory issues please use smaller transactions or use the version (with a different licensing scheme) at: litehelpers / Cordova-sqlite-enterprise-free

Announcements

  • This version supports REGEXP on Android using PCRE 8.37
  • Pre-populated database support for Windows "Universal" in addition to Android, iOS, and Amazon Fire-OS, usage described below
  • PhoneGap Build is now supported through the npm package: http://phonegap.com/blog/2015/05/26/npm-plugins-available/
  • MetaMemoryT / websql-promise now provides a Promises-based interface to both Web SQL and this plugin
  • Android version is now using the lightweight Android-sqlite-connector by default configuration (may be changed as described below)
  • iOS version is now fixed to override the correct pluginInitialize method and should work with recent versions of iOS
  • Project has been renamed to prevent confusion with davibe / Phonegap-SQLitePlugin (original version for iOS, with a different API)
  • New project location (should redirect)
  • The test suite is completely ported to Jasmine (2.2.0) and was used to verify the functionality of the new Windows version
  • SQLCipher for Windows (8.1) in addition to Android & iOS is now supported by litehelpers / Cordova-sqlcipher-adapter
  • New openDatabase and deleteDatabase location option to select database location (iOS only) and disable iCloud backup
  • Fixes to work with PouchDB by @nolanlawson

Highlights

  • Drop-in replacement for HTML5/Web SQL API, the only change should be window.openDatabase() --> sqlitePlugin.openDatabase()
  • Failure-safe nested transactions with batch processing optimizations
  • As described in this posting:
    • Keeps sqlite database in a user data location that is known; can be reconfigured (iOS version); and synchronized to iCloud by default (iOS version; can be disabled as described below).
    • No 5MB maximum, more information at: http://www.sqlite.org/limits.html
  • Pre-populated database option (usage described below)

Some apps using this plugin

Known issues

  • INSERT statement that affects multiple rows (due to SELECT cause or using triggers, for example) does not report proper rowsAffected on Android (in case Android-sqlite-connector is disabled) or Amazon Fire-OS.
  • Memory issue observed when adding a very large number of records (due to JSON implementation) on Android, Amazon Fire-OS (ref: #18), and iOS (ref: #299 and #308)
  • A stability issue was reported on the iOS version when in use together with SockJS client such as pusher-js at the same time (see #196). The workaround is to call sqlite functions and SockJS client functions in separate ticks (using setTimeout with 0 timeout).
  • If a sql statement fails for which there is no error handler or the error handler does not return false to signal transaction recovery, the plugin fires the remaining sql callbacks before aborting the transaction.
  • In case of an error, the error code member is bogus on Android, Amazon Fire-OS, Windows, and WP(7/8) (fixed for Android in litehelpers / Cordova-sqlite-enterprise-free).
  • Possible crash on Android when using Unicode emoji characters due to Android bug 81341, which should be fixed in Android 6.x
  • In-memory database db=window.sqlitePlugin.openDatabase({name: ":memory:"}) is currently not supported.
  • Close database bugs described below.
  • When a database is opened and deleted without closing, the iOS version is known to leak resources.
  • It is NOT possible to open multiple databases with the same name but in different locations (iOS version).
  • DROP table does not actually delete it in WP(7/8) version, due to limitations of CSharp-SQLite.
  • On WP(7/8), very large integer values will be stored as negative numbers.
  • Problems reported with PhoneGap Build in the past:

Other limitations

  • Pre-populated database functionality is NOT and will never be supported for WP(7.x/8.0).
  • The db version, display name, and size parameter values are not supported and will be ignored.
  • This plugin will not work before the callback for the "deviceready" event has been fired, as described in Usage. (This is consistent with the other Cordova plugins.)
  • Will not work within a web worker or iframe since these are not supported by the Cordova framework.
  • In-memory database db=window.sqlitePlugin.openDatabase({name: ":memory:"}) is currently not supported.
  • REGEXP is only supported on iOS (using built-in regex library) and Android (using PCRE on default implementation only); missing for Windows ("Universal") and WP(7/8).
  • The Android and Amazon Fire-OS versions cannot work with more than 100 open db files (due to the threading model used).
  • UNICODE line separator (\u2028) and paragraph separator (\u2029) are currently not supported and known to be broken in iOS version due to Cordova bug CB-9435.
  • UNICODE characters not working in WP(7/8) version
  • Blob type is currently not supported and known to be broken on multiple platforms.
  • UNICODE \u0000 (same as \0) character not working in Windows "Universal" (8.1) or WP(7/8) versions
  • Case-insensitive matching and other string manipulations on Unicode characters, which is provided by optional ICU integration in the sqlite source and working with recent versions of Android, is not supported for any target platforms.
  • iOS version uses a thread pool but with only one thread working at a time due to "synchronized" database access
  • Large query result can be slow, also due to JSON implementation
  • ATTACH another database file is not supported (due to path specifications, which work differently depending on the target platform)
  • User-defined savepoints are not supported and not expected to be compatible with the transaction locking mechanism used by this plugin. In addition, the use of BEGIN/COMMIT/ROLLBACK statements is not supported.
  • Problems have been reported when using this plugin with Crosswalk (for Android). A couple of things you can try:
    • Install Crosswalk as a plugin instead of using Crosswalk to create the project.
    • Use androidDatabaseImplementation: 2 in the openDatabase options as described below.

Further testing needed

  • Multi-page apps
  • Use within InAppBrowser
  • FTS3/FTS4 is not tested or supported for Amazon Fire-OS or WP(7/8)
  • R-Tree is not tested for Android (in case Android-sqlite-connector is disabled), Amazon Fire-OS or WP(7/8)
  • UNICODE characters not fully tested in the Windows "Universal" (8.1) version
  • Use with triggers, JOIN and ORDER BY RANDOM
  • TODO add some REGEXP tests
  • Integration with JXCore for Cordova (must be built without sqlite(3) built-in)
  • Delete an open database inside a statement or transaction callback.

Some tips and tricks

  • If you run into problems and your code follows the asynchronous HTML5/Web SQL transaction API, you can try opening your database using window.openDatabase and see if you get the same problems.

Common pitfalls

  • It is NOT allowed to execute sql statements on a transaction following the HTML5/Web SQL API, as described below.
  • It is possible to make a Windows Phone 8.1 project using either the windows platform or the wp8 platform. The windows platform is highly recommended over wp8 whenever possible. Also, some plugins only support windows and some plugins support only wp8.

Alternatives

Other versions

Other SQLite adapter projects

Alternative solutions

Usage

The idea is to emulate the HTML5/Web SQL API as closely as possible. The only major change is to use window.sqlitePlugin.openDatabase() (or sqlitePlugin.openDatabase()) instead of window.openDatabase(). If you see any other major change please report it, it is probably a bug.

NOTE: If a sqlite statement in a transaction fails with an error, the error handler must return false in order to recover the transaction. This is correct according to the HTML5/Web SQL API standard. This is different from the WebKit implementation of Web SQL in Android and iOS which recovers the transaction if a sql error hander returns a non-true value.

Opening a database

There are two options to open a database access object:

  • Recommended: var db = window.sqlitePlugin.openDatabase({name: "my.db", location: 1});
  • Classical: var db = window.sqlitePlugin.openDatabase("myDatabase.db", "1.0", "Demo", -1);

The new location option is used to select the database subdirectory location (iOS only) with the following choices:

  • 0 (default): Documents - visible to iTunes and backed up by iCloud
  • 1: Library - backed up by iCloud, NOT visible to iTunes
  • 2: Library/LocalDatabase - NOT visible to iTunes and NOT backed up by iCloud

IMPORTANT: Please wait for the "deviceready" event, as in the following example:

// Wait for Cordova to load
document.addEventListener("deviceready", onDeviceReady, false);

// Cordova is ready
function onDeviceReady() {
  var db = window.sqlitePlugin.openDatabase({name: "my.db"});
  // ...
}

NOTES:

  • The database file name should include the extension, if desired.
  • It is possible to open multiple database access objects for the same database.
  • The database access object can be closed as described below.

Pre-populated database

For Android, Amazon Fire-OS, iOS, and Windows "Universal": put the database file in the www directory and open the database like:

var db = window.sqlitePlugin.openDatabase({name: "my.db", createFromLocation: 1});

or to disable iCloud backup:

db = sqlitePlugin.openDatabase({name: "my.db", location: 2, createFromLocation: 1});

IMPORTANT NOTES:

  • Put the pre-populated database file in the www subdirectory. This should work well with using the Cordova CLI to support both Android & iOS versions.
  • The pre-populated database file name must match exactly the file name given in openDatabase. The automatic extension has been completely eliminated.
  • The pre-populated database file is ignored if the database file with the same name already exists in your database file location.

TIP: If you don't see the data from the pre-populated database file, completely remove your app and try it again!

Alternative: You can also use an-rahulpandey / cordova-plugin-dbcopy to install your pre-populated database

Android sqlite implementation

By default, this plugin uses Android-sqlite-connector, which is lightweight and should be more efficient than the built-in Android database classes. To use the built-in Android database classes instead:

var db = window.sqlitePlugin.openDatabase({name: "my.db", androidDatabaseImplementation: 2});

Workaround for Android db locking issue

Issue #193 was reported (as observed by several app developers) that on some newer versions of the Android database classes, if the app is stopped or aborted without closing the database then:

  • (sometimes) there is an unexpected database lock
  • the data that was inserted is lost.

This issue is suspected to be caused by this Android sqlite commit, which references and includes the sqlite commit at: http://www.sqlite.org/src/info/6c4c2b7dba

There is an optional workaround that simply closes and reopens the database file at the end of every transaction that is committed. The workaround is enabled by opening the database with options as follows:

var db = window.sqlitePlugin.openDatabase({name: "my.db", androidDatabaseImplementation: 2, androidLockWorkaround: 1});

This option is ignored if androidDatabaseImplementation: 2 is not specified.

IMPORTANT NOTE: This workaround is only applied when using db.transaction(), not applied when running executeSql() on the database object.

SQL transactions

The following types of SQL transactions are supported by this version:

  • Single-statement transactions
  • Standard asynchronous transactions

Single-statement transactions

Sample:

db.executeSql("SELECT LENGTH('tenletters') AS stringlength", [], function (res) {
  console.log('got stringlength: ' + res.rows.item(0).stringlength);
}, function(error) {
  console.log('SELECT error: ' + error.message);
});

Standard asynchronous transactions

Standard asynchronous transactions follow the HTML5/Web SQL API which is very well documented and uses BEGIN and COMMIT or ROLLBACK to keep the transactions failure-safe. Here is a very simple example from the test suite:

db.transaction(function(tx) {
  tx.executeSql("SELECT UPPER('Some US-ASCII text') AS uppertext", [], function(tx, res) {
    console.log("res.rows.item(0).uppertext: " + res.rows.item(0).uppertext);
  }, function(error) {
    console.log('SELECT error: ' + error.message);
  });
}, function(error) {
  console.log('transaction error: ' + error.message);
}, function() {
  console.log('transaction ok');
});

In case of a read-only transaction, it is possible to use readTransaction which will not use BEGIN, COMMIT, or ROLLBACK:

db.readTransaction(function(tx) {
  tx.executeSql("SELECT UPPER('Some US-ASCII text') AS uppertext", [], function(tx, res) {
    console.log("res.rows.item(0).uppertext: " + res.rows.item(0).uppertext);
  }, function(error) {
    console.log('SELECT error: ' + error.message);
  });
}, function(error) {
  console.log('transaction error: ' + error.message);
}, function() {
  console.log('transaction ok');
});

WARNING: It is NOT allowed to execute sql statements on a transaction after it has finished. Here is an example from my Populating Cordova SQLite storage with the JQuery API post:

  // BROKEN SAMPLE:
  var db = window.sqlitePlugin.openDatabase({name: "test.db"});
  db.executeSql("DROP TABLE IF EXISTS tt");
  db.executeSql("CREATE TABLE tt (data)");

  db.transaction(function(tx) {
    $.ajax({
      url: 'https://api.github.com/users/litehelpers/repos',
      dataType: 'json',
      success: function(res) {
        console.log('Got AJAX response: ' + JSON.stringify(res));
        $.each(res, function(i, item) {
          console.log('REPO NAME: ' + item.name);
          tx.executeSql("INSERT INTO tt values (?)", JSON.stringify(item.name));
        });
      }
    });
  }, function(e) {
    console.log('Transaction error: ' + e.message);
  }, function() {
    // Check results:
    db.executeSql('SELECT COUNT(*) FROM tt', [], function(res) {
      console.log('Check SELECT result: ' + JSON.stringify(res.rows.item(0)));
    });
  });

You can find more details and a step-by-step description how to do this right in the Populating Cordova SQLite storage with the JQuery API post:

Background processing

The threading model depends on which version is used:

  • For Android, Amazon Fire-OS, and WP(7/8), one background thread per db;
  • for iOS, background processing using a very limited thread pool (only one thread working at a time);
  • for Windows "Universal" (8.1), no background processing (for future consideration).

Sample with PRAGMA feature

This is a pretty strong test: first we create a table and add a single entry, then query the count to check if the item was inserted as expected. Note that a new transaction is created in the middle of the first callback.

// Wait for Cordova to load
document.addEventListener("deviceready", onDeviceReady, false);

// Cordova is ready
function onDeviceReady() {
  var db = window.sqlitePlugin.openDatabase({name: "my.db"});

  db.transaction(function(tx) {
    tx.executeSql('DROP TABLE IF EXISTS test_table');
    tx.executeSql('CREATE TABLE IF NOT EXISTS test_table (id integer primary key, data text, data_num integer)');

    // demonstrate PRAGMA:
    db.executeSql("pragma table_info (test_table);", [], function(res) {
      console.log("PRAGMA res: " + JSON.stringify(res));
    });

    tx.executeSql("INSERT INTO test_table (data, data_num) VALUES (?,?)", ["test", 100], function(tx, res) {
      console.log("insertId: " + res.insertId + " -- probably 1");
      console.log("rowsAffected: " + res.rowsAffected + " -- should be 1");

      db.transaction(function(tx) {
        tx.executeSql("select count(id) as cnt from test_table;", [], function(tx, res) {
          console.log("res.rows.length: " + res.rows.length + " -- should be 1");
          console.log("res.rows.item(0).cnt: " + res.rows.item(0).cnt + " -- should be 1");
        });
      });

    }, function(e) {
      console.log("ERROR: " + e.message);
    });
  });
}

NOTE: PRAGMA statements must be executed in executeSql() on the database object (i.e. db.executeSql()) and NOT within a transaction.

Sample with transaction-level nesting

In this case, the same transaction in the first executeSql() callback is being reused to run executeSql() again.

// Wait for Cordova to load
document.addEventListener("deviceready", onDeviceReady, false);

// Cordova is ready
function onDeviceReady() {
  var db = window.sqlitePlugin.openDatabase("Database", "1.0", "Demo", -1);

  db.transaction(function(tx) {
    tx.executeSql('DROP TABLE IF EXISTS test_table');
    tx.executeSql('CREATE TABLE IF NOT EXISTS test_table (id integer primary key, data text, data_num integer)');

    tx.executeSql("INSERT INTO test_table (data, data_num) VALUES (?,?)", ["test", 100], function(tx, res) {
      console.log("insertId: " + res.insertId + " -- probably 1");
      console.log("rowsAffected: " + res.rowsAffected + " -- should be 1");

      tx.executeSql("select count(id) as cnt from test_table;", [], function(tx, res) {
        console.log("res.rows.length: " + res.rows.length + " -- should be 1");
        console.log("res.rows.item(0).cnt: " + res.rows.item(0).cnt + " -- should be 1");
      });

    }, function(e) {
      console.log("ERROR: " + e.message);
    });
  });
}

This case will also works with Safari (WebKit), assuming you replace window.sqlitePlugin.openDatabase with window.openDatabase.

Close a database object

db.close(successcb, errorcb);

It is OK to close the database within a transaction callback but NOT within a statement callback. The following example is OK:

db.transaction(function(tx) {
  tx.executeSql("SELECT LENGTH('tenletters') AS stringlength", [], function(tx, res) {
    console.log('got stringlength: ' + res.rows.item(0).stringlength);
  });
}, function(error) {
  // OK to close here:
  console.log('transaction error: ' + error.message);
  db.close();
}, function() {
  // OK to close here:
  console.log('transaction ok');
  db.close(function() {
    console.log('database is closed ok');
  });
});

The following example is NOT OK:

// BROKEN:
db.transaction(function(tx) {
  tx.executeSql("SELECT LENGTH('tenletters') AS stringlength", [], function(tx, res) {
    console.log('got stringlength: ' + res.rows.item(0).stringlength);
    // BROKEN - this will trigger the error callback:
    db.close(function() {
      console.log('database is closed ok');
    }, function(error) {
      console.log('ERROR closing database');
    });
  });
});

BUG 1: It is currently NOT possible to close a database in a db.executeSql callback. For example:

// BROKEN DUE TO BUG:
db.executeSql("SELECT LENGTH('tenletters') AS stringlength", [], function (res) {
  var stringlength = res.rows.item(0).stringlength;
  console.log('got stringlength: ' + res.rows.item(0).stringlength);

  // BROKEN - this will trigger the error callback DUE TO BUG:
  db.close(function() {
    console.log('database is closed ok');
  }, function(error) {
    console.log('ERROR closing database');
  });
});

BUG 2: If multiple database access objects are opened for the same database and one database access object is closed, the database is no longer available for the other database access objects. Possible workarounds:

  • It is still possible to open one or more new database access objects on a database that has been closed.
  • It should be OK not to explicitly close a database handle since database transactions are ACID compliant and the app's memory resources are cleaned up by the system upon termination.

Delete a database

window.sqlitePlugin.deleteDatabase({name: "my.db", location: 1}, successcb, errorcb);

location as described above for openDatabase (iOS only)

NOTE: not implemented for Windows "Universal" (8.1) version.

Installing

Windows "Universal" target platform

IMPORTANT: There are issues supporing certain Windows target platforms due to CB-8866:

  • When using Visual Studio, the default target ("Mixed Platforms") will not work
  • Problems have been with the Windows "Universal" version case of a Cordova project using a Visual Studio template/extension instead of Cordova/PhoneGap CLI or plugman As an alternative, which will support the ("Mixed Platforms") target, you can use plugman instead with litehelpers / cordova-windows-nufix, as described here.

Using plugman to support "Mixed Platforms"

  • make sure you have the latest version of plugman installed: npm install -g plugman
  • Download the cordova-windows-nufix 3.9.0-nufixpre-01 zipball (or you can clone litehelpers / cordova-windows-nufix instead)
  • Create your Windows "Universal" (8.1) project using litehelpers / cordova-windows-nufix:
    • path.to.cordova-windows-nufix/bin/create.bat your_app_path your.app.id YourAppName
  • cd your_app_path and install plugin using plugman:
    • plugman install --platform windows --project . --plugin https://github.com/brodybits/cordova-sqlite-extras
  • Put your sql program in your project www (don't forget to reference it from www\index.html and wait for deviceready event)

Then your project in CordovaApp.sln should work with "Mixed Platforms" on both Windows 8.1 and Windows Phone 8.1.

Easy install with Cordova CLI tool

npm install -g cordova # if you don't have cordova
cordova create MyProjectFolder com.my.project MyProject && cd MyProjectFolder # if you are just starting
cordova plugin add https://github.com/brodybits/cordova-sqlite-extras

You can find more details at this writeup.

WARNING: as stated above, there are issues using Cordova CLI with Windows ("Universal") target platform due to CB-8866. It is recommended to use plugman instead, as described above.

IMPORTANT: sometimes you have to update the version for a platform before you can build, like: cordova prepare ios

NOTE: If you cannot build for a platform after cordova prepare, you may have to remove the platform and add it again, such as:

cordova platform rm ios
cordova platform add ios

Easy install with plugman tool

plugman install --platform MYPLATFORM --project path.to.my.project.folder --plugin https://github.com/brodybits/cordova-sqlite-extras

where MYPLATFORM is android, ios, windows, or wp8.

A posting how to get started developing on Windows host without the Cordova CLI tool (for Android target only) is available here.

Source tree

  • SQLitePlugin.coffee.md: platform-independent (Literate coffee-script, can be read by recent coffee-script compiler)
  • www: SQLitePlugin.js platform-independent Javascript as generated from SQLitePlugin.coffee.md (and checked in!)
  • src: platform-specific source code:
    • external - placeholder for external dependencies - not required in this version
    • android - Java plugin code for Android (along with Android-sqlite-connector and Android-sqlite-native-driver library jars)
    • android-classic - Java plugin code for Amazon Fire-OS
    • ios - Objective-C plugin code for iOS;
    • windows - Javascript proxy code and SQLite3-WinRT project for Windows "Universal" (8.1);
    • wp - C-sharp code for WP(7/8)
  • spec: test suite using Jasmine (2.2.0), ported from QUnit test-www test suite, working on all platforms
  • tests: very simple Jasmine test suite that is run on Circle CI (Android version) and Travis CI (iOS version)
  • Lawnchair-adapter: Lawnchair adaptor, based on the version from the Lawnchair repository, with the basic Lawnchair test suite in test-www subdirectory

Manual installation - Android version

These installation instructions are based on the Android example project from Cordova/PhoneGap 2.7.0, using the lib/android/example subdirectory from the PhoneGap 2.7 zipball.

  • Install SQLitePlugin.js from www into assets/www
  • Install SQLitePlugin.java from src/android/io/liteglue into src/io/liteglue subdirectory
  • Install the libs subtree with 2 jars from src/android/libs into your Android project
  • Add the plugin element <plugin name="SQLitePlugin" value="io.liteglue.SQLitePlugin"/> to res/xml/config.xml

Sample change to res/xml/config.xml for Cordova/PhoneGap 2.x:

--- config.xml.orig	2015-04-14 14:03:05.000000000 +0200
+++ res/xml/config.xml	2015-04-14 14:08:08.000000000 +0200
@@ -36,6 +36,7 @@
     <preference name="useBrowserHistory" value="true" />
     <preference name="exit-on-suspend" value="false" />
 <plugins>
+    <plugin name="SQLitePlugin" value="io.liteglue.SQLitePlugin"/>
     <plugin name="App" value="org.apache.cordova.App"/>
     <plugin name="Geolocation" value="org.apache.cordova.GeoBroker"/>
     <plugin name="Device" value="org.apache.cordova.Device"/>

Before building for the first time, you have to update the project with the desired version of the Android SDK with a command like:

android update project --path $(pwd) --target android-19

(assuming Android SDK 19, use the correct desired Android SDK number here)

NOTE: using this plugin on Cordova pre-3.0 requires the following changes to SQLiteAndroidDatabase.java and SQLitePlugin.java:

--- Cordova-sqlite-storage/src/android/io/liteglue/SQLiteAndroidDatabase.java	2015-04-14 14:05:01.000000000 +0200
+++ src/io/liteglue/SQLiteAndroidDatabase.java	2015-04-14 14:15:23.000000000 +0200
@@ -24,7 +24,7 @@
 import java.util.regex.Matcher;
 import java.util.regex.Pattern;
 
-import org.apache.cordova.CallbackContext;
+import org.apache.cordova.api.CallbackContext;
 
 import org.json.JSONArray;
 import org.json.JSONException;
diff -u Cordova-sqlite-storage/src/android/io/liteglue/SQLitePlugin.java src/io/liteglue/SQLitePlugin.java
--- Cordova-sqlite-storage/src/android/io/liteglue/SQLitePlugin.java	2015-04-14 14:05:01.000000000 +0200
+++ src/io/liteglue/SQLitePlugin.java	2015-04-14 14:10:44.000000000 +0200
@@ -22,8 +22,8 @@
 import java.util.regex.Matcher;
 import java.util.regex.Pattern;
 
-import org.apache.cordova.CallbackContext;
-import org.apache.cordova.CordovaPlugin;
+import org.apache.cordova.api.CallbackContext;
+import org.apache.cordova.api.CordovaPlugin;
 
 import org.json.JSONArray;
 import org.json.JSONException;

Manual installation - iOS version

SQLite library

In the Project "Build Phases" tab, select the first "Link Binary with Libraries" dropdown menu and add the library libsqlite3.dylib or libsqlite3.0.dylib.

NOTE: In the "Build Phases" there can be multiple "Link Binary with Libraries" dropdown menus. Please select the first one otherwise it will not work.

SQLite Plugin

  • Copy SQLitePlugin.[hm] from src/ios into your project Plugins folder and add them in XCode (I always just have "Create references" as the option selected).
  • Copy SQLitePlugin.js from www into your project www folder
  • Enable the SQLitePlugin in config.xml

Sample change to config.xml for Cordova/PhoneGap 2.x:

--- config.xml.old	2013-05-17 13:18:39.000000000 +0200
+++ config.xml	2013-05-17 13:18:49.000000000 +0200
@@ -39,6 +39,7 @@
     <content src="index.html" />
 
     <plugins>
+        <plugin name="SQLitePlugin" value="SQLitePlugin" />
         <plugin name="Device" value="CDVDevice" />
         <plugin name="Logger" value="CDVLogger" />
         <plugin name="Compass" value="CDVLocation" />

Manual installation - Windows "Universal" (8.1) version

Described above.

Manual installation - WP(7/8) version

TBD

Quick installation test

Assuming your app has a recent template as used by the Cordova create script, add the following code to the onDeviceReady function, after app.receivedEvent('deviceready');:

  window.sqlitePlugin.openDatabase({ name: 'hello-world.db' }, function (db) {
    db.executeSql("select length('tenletters') as stringlength", [], function (res) {
      var stringlength = res.rows.item(0).stringlength;
      console.log('got stringlength: ' + stringlength);
      document.getElementById('deviceready').querySelector('.received').innerHTML = 'stringlength: ' + stringlength;
   });
  });

Old installation test

Make a change like this to index.html (or use the sample code) verify proper installation:

--- index.html.old	2012-08-04 14:40:07.000000000 +0200
+++ assets/www/index.html	2012-08-04 14:36:05.000000000 +0200
@@ -24,7 +24,35 @@
     <title>PhoneGap</title>
       <link rel="stylesheet" href="master.css" type="text/css" media="screen" title="no title">
       <script type="text/javascript" charset="utf-8" src="cordova-2.0.0.js"></script>
-      <script type="text/javascript" charset="utf-8" src="main.js"></script>
+      <script type="text/javascript" charset="utf-8" src="SQLitePlugin.js"></script>
+
+
+      <script type="text/javascript" charset="utf-8">
+      document.addEventListener("deviceready", onDeviceReady, false);
+      function onDeviceReady() {
+        var db = window.sqlitePlugin.openDatabase("Database", "1.0", "Demo", -1);
+
+        db.transaction(function(tx) {
+          tx.executeSql('DROP TABLE IF EXISTS test_table');
+          tx.executeSql('CREATE TABLE IF NOT EXISTS test_table (id integer primary key, data text, data_num integer)');
+
+          tx.executeSql("INSERT INTO test_table (data, data_num) VALUES (?,?)", ["test", 100], function(tx, res) {
+          console.log("insertId: " + res.insertId + " -- probably 1"); // check #18/#38 is fixed
+          alert("insertId: " + res.insertId + " -- should be valid");
+
+            db.transaction(function(tx) {
+              tx.executeSql("SELECT data_num from test_table;", [], function(tx, res) {
+                console.log("res.rows.length: " + res.rows.length + " -- should be 1");
+                alert("res.rows.item(0).data_num: " + res.rows.item(0).data_num + " -- should be 100");
+              });
+            });
+
+          }, function(e) {
+            console.log("ERROR: " + e.message);
+          });
+        });
+      }
+      </script>
 
   </head>
   <body onload="init();" id="stage" class="theme">

Common traps & pitfalls

  • The plugin class name starts with "SQL" in capital letters, but in Javascript the sqlitePlugin object name starts with "sql" in small letters.
  • Attempting to open a database before receiving the "deviceready" event callback.

Support

Policy

As described above, free support will be provided on a very limited basis due to some changing priorities. In addition, free support is only available in public forums. Please follow the steps below to be sure you have done your best before requesting help.

Commercial support is available by contacting: [email protected]

Before asking for help

If you have an issue with the plugin please check the following first:

  • You are using the latest version of the Plugin Javascript & platform-specific Java or Objective-C source from this repository.
  • You have installed the Javascript & platform-specific Java or Objective-C correctly.
  • You have included the correct version of the cordova Javascript and SQLitePlugin.js and got the path right.
  • You have registered the plugin properly in config.xml.

If you still cannot get something to work, please create a fresh, clean Cordova project, add this plugin according to the instructions above, and try a simple test program.

If you continue to see the issue in a new, clean Cordova project:

  • Make the simplest test program you can to demonstrate the issue, including the following characteristics:
    • it completely self-contained, i.e. it is using no extra libraries beyond cordova & SQLitePlugin.js;
    • if the issue is with adding data to a table, that the test program includes the statements you used to open the database and create the table;
    • if the issue is with retrieving data from a table, that the test program includes the statements you used to open the database, create the table, and enter the data you are trying to retrieve.

Before asking for help with a pre-populated database

This plugin has been tested and successfully used with pre-populated databases. But you have to do it very carefully. If you are having any trouble, please start with a new, clean Cordova project, add this plugin, use the sqlite3 tool to make a small test database, and try to read it.

What will be supported for free

Please make a small, self-contained test program that can demonstrate your problem and post it. Please do not use any other plugins or frameworks than are absolutely necessary to demonstrate your problem.

In case of a problem with a pre-populated database, please post your entire project.

Support for issues with Angular/"ngCordova"/Ionic

Free support for issues with Angular/"ngCordova"/Ionic will only be provided if you can demonstrate that you can do the same thing without such a framework.

  • Make a fresh, clean ngCordova or Ionic project with a test program that demonstrates the issue and post it. Please do not use any other plugins or frameworks unless absolutely necessary to demonstrate your issue.
  • Make another project without any form of Angular including ngCordova or Ionic, with the same test program to show that it will work outside Angular/"ngCordova"/Ionic.

What information is needed for help

Please include the following:

  • Which platform(s) Android/iOS/WP8/Windows 8.1/Windows Phone 8.1
  • Clear description of the issue
  • A small, complete, self-contained program that demonstrates the problem

Where to ask for help

Once you have followed the directions above, you may request free support in the following locations:

Please include the information described above otherwise.

Professional support

Professional support is available, please contact: [email protected]

Unit tests

Unit testing is done in spec.

running tests from shell

To run the tests from *nix shell, simply do either:

./bin/test.sh ios

or for Android:

./bin/test.sh android

To run then from a windows powershell do either

.\bin\test.ps1 android

or for Windows (8.1):

.\bin\test.ps1 windows

or for Windows Phone (7/8):

.\bin\test.ps1 wp8

Adapters

Lawnchair Adapter

Common adapter

Please look at the Lawnchair-adapter tree that contains a common adapter, which should also work with the Android version, along with a test-www directory.

Included files

Include the following Javascript files in your HTML:

  • cordova.js (don't forget!)
  • lawnchair.js (you provide)
  • SQLitePlugin.js (in case of Cordova pre-3.0)
  • Lawnchair-sqlitePlugin.js (must come after SQLitePlugin.js in case of Cordova pre-3.0)

Sample

The name option determines the sqlite database filename, with no extension automatically added. Optionally, you can change the db filename using the db option.

In this example, you would be using/creating a database with filename kvstore:

kvstore = new Lawnchair({name: "kvstore"}, function() {
  // do stuff
);

Using the db option you can specify the filename with the desired extension and be able to create multiple stores in the same database file. (There will be one table per store.)

recipes = new Lawnchair({db: "cookbook", name: "recipes", ...}, myCallback());
ingredients = new Lawnchair({db: "cookbook", name: "ingredients", ...}, myCallback());

KNOWN ISSUE: the new db options are not supported by the Lawnchair adapter. The workaround is to first open the database file using sqlitePlugin.openDatabase().

PouchDB

The adapter is now part of PouchDB thanks to @nolanlawson, see PouchDB FAQ.

NOTE: The PouchDB adapter has not been tested with the new Android-sqlite-connector. You may need to include androidDatabaseImplementation: 2 in the sqlitePlugin.openDatabase() options as described above.

Contributing

Community

Code

WARNING: Please do NOT propose changes from your default branch. In general, contributions are rebased using git rebase or git cherry-pick and not merged.

  • Patches with bug fixes are helpful, especially when submitted with test code.
  • Other enhancements welcome for consideration, when submitted with test code and are working for all supported platforms. Increase of complexity should be avoided.
  • All contributions may be reused by @brodybits (Chris Brody) under another license in the future. Efforts will be taken to give credit for major contributions but it will not be guaranteed.
  • Project restructuring, i.e. moving files and/or directories around, should be avoided if possible.
  • If you see a need for restructuring, it is better to discuss it first in a new issue where alternatives can be discussed before reaching a conclusion. If you want to propose a change to the project structure:
    • Remember to make (and use) a special branch within your fork from which you can send the proposed restructuring;
    • Always use git mv to move files & directories;
    • Never mix a move/rename operation with any other changes in the same commit.

Other

@brodybits (Chris Brody) and others contribute their valuable time and expertise to maintain this project for the benefit of the mobile app community. Small consulting relationships can help strengthen the business viability of this project (see contact below).

Major branches

  • common-src - source for Android (not using Android-sqlite-connector), iOS, Windows (8.1), and Amazon Fire-OS versions (shared with litehelpers / Cordova-sqlcipher-adapter)
  • new-common-src - source for Android (using Android-sqlite-connector), iOS, Windows (8.1), and Amazon Fire-OS versions
  • new-common-rc - pre-release version for Android/iOS/Windows (8.1), including library dependencies for Android and Windows (8.1)
  • wp-src - source for Android (not using Android-sqlite-connector), iOS, WP(7/8), and Amazon Fire-OS versions
  • wp-master-rc - pre-release version for Android(not using Android-sqlite-connector)/iOS/WP(7/8), including source for CSharp-SQLite (C#) library classes
  • master-rc - pre-release version for all supported platforms, including library dependencies for Android, Windows (8.1), and WP(7/8)
  • [FUTURE TBD] master - version for release, to be included in PhoneGap build.

Contact

[email protected]