* WIP * WIP - make test_model_definition tests pass * WIP - make test_model_methods pass * WIP - make whole test suit at least run - failing 49/443 tests * WIP fix part of the getting pydantic tests as types of fields are now kept in core schema and not on fieldsinfo * WIP fix validation in update by creating individual fields validators, failing 36/443 * WIP fix __pydantic_extra__ in intializing model, fix test related to pydantic config checks, failing 32/442 * WIP - fix enum schema in model_json_schema, failing 31/442 * WIP - fix copying through model, fix setting pydantic fields on through, fix default config and inheriting from it, failing 26/442 * WIP fix tests checking pydantic schema, fix excluding parent fields, failing 21/442 * WIP some missed files * WIP - fix validators inheritance and fix validators in generated pydantic, failing 17/442 * WIP - fix through models setting - only on reverse side of relation, but always on reverse side, failing 15/442 * WIP - fix through models setting - only on reverse side of relation, but always on reverse side, failing 15/442 * WIP - working on proper populating __dict__ for relations for new schema dumping, some work on openapi docs, failing 13/442 * WIP - remove property fields as pydantic has now computed_field on its own, failing 9/442 * WIP - fixes in docs, failing 8/442 * WIP - fix tests for largebinary schema, wrapped bytes fields fail in pydantic, will be fixed in pydantic-core, remaining is circural schema for related models, failing 6/442 * WIP - fix to pk only models in schemas * Getting test suites to pass (#1249) * wip, fixing tests * iteration, fixing some more tests * iteration, fixing some more tests * adhere to comments * adhere to comments * remove unnecessary dict call, re-add getattribute for testing * todo for reverse relationship * adhere to comments, remove prints * solve circular refs * all tests pass 🎉 * remove 3.7 from tests * add lint and type check jobs * reforat with ruff, fix jobs * rename jobs * fix imports * fix evaluate in py3.8 * partially fix coverage * fix coverage, add more tests * fix test ids * fix test ids * fix lint, fix docs, make docs fully working scripts, add test docs job * fix pyproject * pin py ver in test docs * change dir in test docs * fix pydantic warning hack * rm poetry call in test_docs * switch to pathlib in test docs * remove coverage req test docs * fix type check tests, fix part of types * fix/skip next part of types * fix next part of types * fix next part of types * fix coverage * fix coverage * fix type (bit dirty 🤷) * fix some code smells * change pre-commit * tweak workflows * remove no root from tests * switch to full python path by passing sys.executable * some small refactor in new base model, one sample test, change makefile * small refactors to reduce complexity of methods * temp add tests for prs against pydantic_v2 * remove all references to __fields__ * remove all references to construct, deprecate the method and update model_construct to be in line with pydantic * deprecate dict and add model_dump, todo switch to model_dict in calls * fix tests * change to union * change to union * change to model_dump and model_dump_json from dict and json deprecated methods, deprecate them in ormar too * finish switching dict() -> model_dump() * finish switching json() -> model_dump_json() * remove fully pydantic_only * switch to extra for payment card, change missed json calls * fix coverage - no more warnings internal * fix coverage - no more warnings internal - part 2 * split model_construct into own and pydantic parts * split determine pydantic field type * change to new field validators * fix benchmarks, add codspeed instead of pytest-benchmark, add action and gh workflow * restore pytest-benchmark * remove codspeed * pin pydantic version, restore codspeed * change on push to pydantic_v2 to trigger first one * Use lifespan function instead of event (#1259) * check return types * fix imports order, set warnings=False on json that passes the dict, fix unnecessary loop in one of the test * remove references to model's meta as it's now ormar config, rename related methods too * filter out pydantic serializer warnings * remove choices leftovers * remove leftovers after property_fields, keep only enough to exclude them in initialization * add migration guide * fix meta references * downgrade databases for now * Change line numbers in documentation (#1265) * proofread and fix the docs, part 1 * proofread and fix the docs for models * proofread and fix the docs for fields * proofread and fix the docs for relations * proofread and fix rest of the docs, add release notes for 0.20 * create tables in new docs src * cleanup old deps, uncomment docs publish on tag * fix import reorder --------- Co-authored-by: TouwaStar <30479449+TouwaStar@users.noreply.github.com> Co-authored-by: Goran Mekić <meka@tilda.center>
330 lines
8.8 KiB
Markdown
330 lines
8.8 KiB
Markdown
# Migration to 0.20.0 based on pydantic 2.X.X
|
|
|
|
Version 0.20.0 provides support for pydantic v2.X.X that provides significant speed boost (validation and serialization is written in rust) and cleaner api for developers,
|
|
at the same time it drops support for pydantic v.1.X.X. There are changes in `ormar` interface corresponding to changes made in `pydantic`.
|
|
|
|
## Breaking changes
|
|
|
|
Migration to version >= 0.20.0 requires several changes in order to work properly.
|
|
|
|
## `ormar` Model configuration
|
|
|
|
Instead of defining a `Meta` class now each of the ormar models require an ormar_config parameter that is an instance of the `OrmarConfig` class.
|
|
Note that the attribute must be named `ormar_config` and be an instance of the config class.
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
# ormar < 0.20
|
|
class Album(ormar.Model):
|
|
class Meta:
|
|
database = database
|
|
metadata = metadata
|
|
tablename = "albums"
|
|
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
favorite: bool = ormar.Boolean(default=False)
|
|
|
|
# ormar >= 0.20
|
|
class AlbumV20(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="albums_v20"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
favorite: bool = ormar.Boolean(default=False)
|
|
```
|
|
|
|
### `OrmarConfig` api/ parameters
|
|
|
|
The `ormar_config` expose the same set of settings as `Meta` class used to provide.
|
|
That means that you can use any of the following parameters initializing the config:
|
|
|
|
```python
|
|
metadata: Optional[sqlalchemy.MetaData]
|
|
database: Optional[databases.Database]
|
|
engine: Optional[sqlalchemy.engine.Engine]
|
|
tablename: Optional[str]
|
|
order_by: Optional[List[str]]
|
|
abstract: bool
|
|
exclude_parent_fields: Optional[List[str]]
|
|
queryset_class: Type[QuerySet]
|
|
extra: Extra
|
|
constraints: Optional[List[ColumnCollectionConstraint]]
|
|
```
|
|
|
|
### `BaseMeta` equivalent - best practice
|
|
|
|
Note that to reduce the duplication of code and ease of development it's still recommended to create a base config and provide each of the models with a copy.
|
|
OrmarConfig provides a convenient `copy` method for that purpose.
|
|
|
|
The `copy` method accepts the same parameters as `OrmarConfig` init, so you can overwrite if needed, but by default it will return already existing attributes, except for: `tablename`, `order_by` and `constraints` which by default are cleared.
|
|
|
|
```python hl_lines="5-8 11 20"
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
base_ormar_config = ormar.OrmarConfig(
|
|
database=databases.Database("sqlite:///db.sqlite"),
|
|
metadata=sqlalchemy.MetaData()
|
|
)
|
|
|
|
class AlbumV20(ormar.Model):
|
|
ormar_config = base_ormar_config.copy(
|
|
tablename="albums_v20"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
|
|
|
|
class TrackV20(ormar.Model):
|
|
ormar_config = base_ormar_config.copy(
|
|
tablename="tracks_v20"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
```
|
|
|
|
## `choices` Field parameter is no longer supported.
|
|
|
|
Before version 0.20 you could provide `choices` parameter to any existing ormar Field to limit the accepted values.
|
|
This functionality was dropped, and you should use `ormar.Enum` field that was designed for this purpose.
|
|
If you want to keep the database field type (i.e. an Integer field) you can always write a custom validator.
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
# ormar < 0.20
|
|
class Artist(ormar.Model):
|
|
class Meta:
|
|
database = database
|
|
metadata = metadata
|
|
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
country: str = ormar.String(default=False, max_length=50, choices=["UK", "US", "Vietnam", "Colombia"])
|
|
|
|
# ormar >= 0.20
|
|
from enum import Enum
|
|
|
|
class Country(str, Enum):
|
|
UK = "UK"
|
|
US = "US"
|
|
VIETNAM = "Vietnam"
|
|
COLOMBIA = "Colombia"
|
|
|
|
class ArtistV20(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="artists_v20"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
country: Country = ormar.Enum(enum_class=Country)
|
|
```
|
|
|
|
|
|
## `pydantic_only` Field parameter is no longer supported
|
|
|
|
`pydantic_only` fields were already deprecated and are removed in v 0.20. Ormar allows defining pydantic fields as in ordinary pydantic model.
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
# ormar < 0.20
|
|
class Dish(ormar.Model):
|
|
class Meta:
|
|
database = database
|
|
metadata = metadata
|
|
tablename = "dishes"
|
|
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
cook: str = ormar.String(max_length=40, pydantic_only=True, default="sam")
|
|
|
|
# ormar >= 0.20
|
|
class DishV20(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="dishes_v20"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
cook: str = "sam" # this is normal pydantic field
|
|
```
|
|
|
|
## `property_field` decorator is no longer supported
|
|
|
|
`property_field` decorator was used to provide a way to pass calculated fields that were included in dictionary/ serialized json representation of the model.
|
|
Version 2.X of pydantic introduced such a possibility, so you should now switch to the one native to the pydantic.
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
import pydantic
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
# ormar < 0.20
|
|
class Employee(ormar.Model):
|
|
class Meta:
|
|
database = database
|
|
metadata = metadata
|
|
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
first_name: str = ormar.String(max_length=100)
|
|
last_name: str = ormar.String(max_length=100)
|
|
|
|
@ormar.property_field()
|
|
def full_name(self) -> str:
|
|
return f"{self.first_name} {self.last_name}"
|
|
|
|
# ormar >= 0.20
|
|
class EmployeeV20(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
first_name: str = ormar.String(max_length=100)
|
|
last_name: str = ormar.String(max_length=100)
|
|
|
|
@pydantic.computed_field()
|
|
def full_name(self) -> str:
|
|
return f"{self.first_name} {self.last_name}"
|
|
```
|
|
|
|
## Deprecated methods
|
|
|
|
All methods listed below are deprecated and will be removed in version 0.30 of `ormar`.
|
|
|
|
### `dict()` becomes the `model_dump()`
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
class Album(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="albums"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
favorite: bool = ormar.Boolean(default=False)
|
|
|
|
album = Album(name="Dark Side of the Moon")
|
|
|
|
# ormar < 0.20
|
|
album_dict = album.dict()
|
|
|
|
# ormar >= 0.20
|
|
new_album_dict = album.model_dump()
|
|
```
|
|
|
|
Note that parameters remain the same i.e. `include`, `exclude` etc.
|
|
|
|
### `json()` becomes the `model_dump_json()`
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
class Album(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="albums"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
favorite: bool = ormar.Boolean(default=False)
|
|
|
|
album = Album(name="Dark Side of the Moon")
|
|
|
|
# ormar < 0.20
|
|
album_json= album.json()
|
|
|
|
# ormar >= 0.20
|
|
new_album_dict = album.model_dump_json()
|
|
```
|
|
|
|
Note that parameters remain the same i.e. `include`, `exclude` etc.
|
|
|
|
### `construct()` becomes the `model_construct()`
|
|
|
|
```python
|
|
import databases
|
|
import ormar
|
|
import sqlalchemy
|
|
|
|
database = databases.Database("sqlite:///db.sqlite")
|
|
metadata = sqlalchemy.MetaData()
|
|
|
|
class Album(ormar.Model):
|
|
ormar_config = ormar.OrmarConfig(
|
|
database=database,
|
|
metadata=metadata,
|
|
tablename="albums"
|
|
)
|
|
|
|
id: int = ormar.Integer(primary_key=True)
|
|
name: str = ormar.String(max_length=100)
|
|
favorite: bool = ormar.Boolean(default=False)
|
|
|
|
params = {
|
|
"name": "Dark Side of the Moon",
|
|
"favorite": True,
|
|
}
|
|
# ormar < 0.20
|
|
album = Album.construct(**params)
|
|
|
|
# ormar >= 0.20
|
|
album = Album.model_construct(**params)
|
|
```
|
|
|
|
To read more about construct please refer to `pydantic` documentation. |