I would think so too. As a quick test I added chinook.db to a fresh repository, committed it, added a row to a table, committed again, and then did a git gc.

The resulting pack file, with two revisions of the database, is 329k. The raw database is 864k and gzips to 328k.

So it does look like git's delta encoding works with sqlite's blocks.