INTPYTHON-527 Add Queryable Encryption support #329

aclark4life · 2025-06-27T02:16:28Z

PR docs: https://django-mongodb-backend--329.org.readthedocs.build/en/329/

Previous attempts and additional context here:

INTPYTHON-527 Add Queryable Encryption config #318
- Branched from transaction support and includes only helpers
INTPYTHON-527 Add queryable encryption support #319
- In which this bug in libmongocrypt was discovered
- A fix for that bug in PyMongo is being discussed here.
INTPYTHON-527 Add Queryable Encryption support #323
- Before I understood that the shared lib for mongocrypt was included in the pymongocrypt wheel.
Add test for "Encrypted fields found" error (ensure this exception still happens)
Add check for model schema not matching encrypted fields
Document key_vault_namespace must be encrypted db
Document that fields within EmbeddedModelArrayField can't be encrypted
Document workflow:
- Develop and test local
- Deploy and run migrate
- Run showencryptedfieldsmap and set encrypted_fields_map in auto_encryption_opts
- Deploy again

tests/encryption_/tests.py

django_mongodb_backend/models.py

django_mongodb_backend/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/base.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/features.py

django_mongodb_backend/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

tests/encryption_/routers.py

tests/encryption_/models.py

tests/backend_/test_features.py

django_mongodb_backend/schema.py

tests/encryption_/models.py

django_mongodb_backend/schema.py

django_mongodb_backend/encryption.py

tests/encryption_/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/models.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

docs/source/ref/encryption.rst

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

…ove mongocryptd

… it part of the normal flow

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

- avoid encryption tasks on non-encrypted builds - retrieve configured provider from conn settings - fail loudly & avoid uppercased values in settings

aclark4life commented Jun 27, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/models.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/encryption.py Outdated Show resolved Hide resolved

timgraham reviewed Jun 27, 2025

View reviewed changes

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jun 30, 2025

View reviewed changes

django_mongodb_backend/features.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/routers.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 4, 2025

View reviewed changes

tests/encryption_/models.py Show resolved Hide resolved

timgraham reviewed Jul 7, 2025

View reviewed changes

tests/encryption_/models.py Outdated Show resolved Hide resolved

aclark4life commented Jul 7, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 9, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

aclark4life commented Jul 11, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

WaVEV and others added 29 commits December 11, 2025 18:04

Wrap query for global aggregation

4dcf235

[temp] remove Django tests for faster CI

d747310

INTPYTHON-527 Add Queryable Encryption support

fc3915b

[wip] updates to field docs

0e4c9ef

add QuerySet tests

913e669

use shared library instead of mongocryptd

f5dfa89

adjust message and add test for missing auto_encryption_opts error

233fa08

polish howto

9050bd0

doc query limitations + docs polish + todos

98dfa80

edit "Dynamic library path configuration"

93737ec

combine topic guide with howto

fc30ab2

Remove QE from 5.2.0 beta 2 release notes

3e2ae81

Add "start csfle servers" func to evergreen config

ce41b74

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

remove support for multiple kms providers

8ca71d2

fix join tests following foreignField/localField refactor

a64e494

Add tests-8-qe to evergreen buildvariants

0f43b90

fix less than lookup on encrypted fields

34b710b

simplify "Configuring the Automatic Encryption Shared Library" to rem…

8bc86ad

…ove mongocryptd

reorder "Configuring the Automatic Encryption Shared Library" to make…

20c6c9a

… it part of the normal flow

update docs/tests for $facet removal

f83c854

Combine crypt shared w/installation & db setup

0bbb296

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

versionadded updated from 5.2.3 to 6.0.0.

d47e067

Configure AWS KMS for testing on evergreen

060b315

doc edits

ffe0b17

Address review

2f73363

- avoid encryption tasks on non-encrypted builds - retrieve configured provider from conn settings - fail loudly & avoid uppercased values in settings

Address UAT feedback

8344284

Address review

08ef851

Update versionadded 6.0.0 -> 6.0.1

723a46f

Address UAT feedback

78af9b4

aclark4life force-pushed the INTPYTHON-527 branch from 422d385 to 78af9b4 Compare December 11, 2025 23:04

INTPYTHON-527 Add Queryable Encryption support #329

Are you sure you want to change the base?

INTPYTHON-527 Add Queryable Encryption support #329

Uh oh!

Conversation

aclark4life commented Jun 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

aclark4life commented Jun 27, 2025 •

edited

Loading