リレーションと JOIN(目次のみ)¶
このドキュメントでは Peewee がモデル間のリレーションシップを処理する 方法について記載します。
モデル定義¶
例として、以下のモデル定義があるとします:
import datetime
from peewee import *
db = SqliteDatabase(':memory:')
class BaseModel(Model):
class Meta:
database = db
class User(BaseModel):
username = TextField()
class Tweet(BaseModel):
content = TextField()
timestamp = DateTimeField(default=datetime.datetime.now)
user = ForeignKeyField(User, backref='tweets')
class Favorite(BaseModel):
user = ForeignKeyField(User, backref='favorites')
tweet = ForeignKeyField(Tweet, backref='favorites')
Peewee は ForeignKeyField
を使ってモデル間の外部キーによる
リレーションシップを定義します。それぞれの外部キーフィールドは、暗黙の
後方参照を持っています。これは提供された backref
属性を使って、事前
フィルタされた Select
クエリーとして見えるようになります。
テストデータの作成¶
この例に沿って、このデータベースにいくつかのテストデータを作成してみましょう:
def populate_test_data():
db.create_tables([User, Tweet, Favorite])
data = (
('huey', ('meow', 'hiss', 'purr')),
('mickey', ('woof', 'whine')),
('zaizee', ()))
for username, tweets in data:
user = User.create(username=username)
for tweet in tweets:
Tweet.create(user=user, content=tweet)
# 以下のようにそれぞれのユーザが好きなものを定義してみましょう:
favorite_data = (
('huey', ['whine']),
('mickey', ['purr']),
('zaizee', ['meow', 'purr']))
for username, favorites in favorite_data:
user = User.get(User.username == username)
for content in favorites:
tweet = Tweet.get(Tweet.content == content)
Favorite.create(user=user, tweet=tweet)
これにより以下の出力が得れれます:
User |
Tweet |
Favorited by |
---|---|---|
huey |
meow |
zaizee |
huey |
hiss |
|
huey |
purr |
mickey, zaizee |
mickey |
woof |
|
mickey |
whine |
huey |
Attention
以下の例では大量のクエリーを実行します。クエリーがいくつ実行されるのか わからない方は、以下のコードを追加することで、コンソールにすべてのクエリー のログを出すことができます:
import logging
logger = logging.getLogger('peewee')
logger.addHandler(logging.StreamHandler())
logger.setLevel(logging.DEBUG)
Note
In SQLite, foreign keys are not enabled by default. Most things, including
the Peewee foreign-key API, will work fine, but ON DELETE behaviour will be
ignored, even if you explicitly specify on_delete
in your
ForeignKeyField
. In conjunction with the default
AutoField
behaviour (where deleted record IDs can be reused),
this can lead to subtle bugs. To avoid problems, I recommend that you
enable foreign-key constraints when using SQLite, by setting
pragmas={'foreign_keys': 1}
when you instantiate SqliteDatabase
.
# 外部キー制約が強制されるようにします。
db = SqliteDatabase('my_app.db', pragmas={'foreign_keys': 1})
単純な JOIN の実行¶
Peewee で JOIN がどのように実行されるのかを学ぶための実例として、”huey”
さんのすべてのツイートを表示するためのクエリーを書いてみましょう。これを
行うため、まず Tweet
モデルを SELECT し、User
モデルを JOIN します。
これにより User.username
フィールドでフィルタすることができます:
>>> query = Tweet.select().join(User).where(User.username == 'huey')
>>> for tweet in query:
... print(tweet.content)
...
meow
hiss
purr
Note
JOIN の述語(”ON” 句)を明示する必要はありません。これは、モデル
定義により Tweet から User への JOIN をすることを Peewee が推測し、
Tweet.user
の外部キーを使った JOIN を行うからです。
以下のコードは同等の動きをするものですが、より明示的な書き方です:
query = (Tweet
.select()
.join(User, on=(Tweet.user == User.id))
.where(User.username == 'huey'))
“huey” のための User
オブジェクトへの参照がすでにあるため、User.tweets
後方参照を使って huey のすべてのツイートのリストを出すことができました:
>>> huey = User.get(User.username == 'huey')
>>> for tweet in huey.tweets:
... print(tweet.content)
...
meow
hiss
purr
huey.tweets
ツイートをよく見てみると、これは単純に事前フィルタされた
SELECT
クエリーであることがわかります:
>>> huey.tweets
<peewee.ModelSelect at 0x7f0483931fd0>
>>> huey.tweets.sql()
('SELECT "t1"."id", "t1"."content", "t1"."timestamp", "t1"."user_id"
FROM "tweet" AS "t1" WHERE ("t1"."user_id" = ?)', [1])
複数のテーブルを JOIN する¶
ユーザの一覧と、彼らがいいねしたツイートがどれくらいあるかを取得するという クエリーを使って別の JOIN の例を見てみましょう。これは2回 JOIN する必要が あります。まずユーザからツイートへ、そしてツイートからいいね(favorite)です。 一度もツイートしていないユーザや、自分のツイートに全くいいねをもらえていない ユーザも含める必要があります。クエリーを SQL で表現すると以下のようになる でしょう:
SELECT user.username, COUNT(favorite.id)
FROM user
LEFT OUTER JOIN tweet ON tweet.user_id = user.id
LEFT OUTER JOIN favorite ON favorite.tweet_id = tweet.id
GROUP BY user.username
Note
上記のクエリーでは2つの JOIN がいずれも LEFT OUTER となっています。 これは、ユーザが全くツイートをしていないかもしれないのと、ツイートを していても、誰からもいいねをもらえていないかもしれないからです。
Peewee には JOIN コンテキスト という考え方があります。これは、どこで
join()
をコールしても、暗黙に直前に JOIN されたモデル
(これが最初の JOIN の場合は SELECT しようとしているモデル)に対する JOIN
を行うということです。ここではユーザからツイート、そしてツイートから
favorite と直線的に JOIN しようとしているので、単純に以下のように書きます:
query = (User
.select(User.username, fn.COUNT(Favorite.id).alias('count'))
.join(Tweet, JOIN.LEFT_OUTER) # Joins user -> tweet.
.join(Favorite, JOIN.LEFT_OUTER) # Joins tweet -> favorite.
.group_by(User.username))
Iterating over the results:
>>> for user in query:
... print(user.username, user.count)
...
huey 3
mickey 1
zaizee 0
For a more complicated example involving multiple joins and switching join contexts, let’s find all the tweets by Huey and the number of times they’ve been favorited. To do this we’ll need to perform two joins and we’ll also use an aggregate function to calculate the favorite count.
Here is how we would write this query in SQL:
SELECT tweet.content, COUNT(favorite.id)
FROM tweet
INNER JOIN user ON tweet.user_id = user.id
LEFT OUTER JOIN favorite ON favorite.tweet_id = tweet.id
WHERE user.username = 'huey'
GROUP BY tweet.content;
Note
We use a LEFT OUTER join from tweet to favorite since a tweet may not have any favorites, yet we still wish to display it’s content (along with a count of zero) in the result set.
With Peewee, the resulting Python code looks very similar to what we would write in SQL:
query = (Tweet
.select(Tweet.content, fn.COUNT(Favorite.id).alias('count'))
.join(User) # Join from tweet -> user.
.switch(Tweet) # Move "join context" back to tweet.
.join(Favorite, JOIN.LEFT_OUTER) # Join from tweet -> favorite.
.where(User.username == 'huey')
.group_by(Tweet.content))
Note the call to switch()
- that instructs Peewee to set
the join context back to Tweet
. If we had omitted the explicit call to
switch, Peewee would have used User
(the last model we joined) as the join
context and constructed the join from User to Favorite using the
Favorite.user
foreign-key, which would have given us incorrect results.
If we wanted to omit the join-context switching we could instead use the
join_from()
method. The following query is equivalent to
the previous one:
query = (Tweet
.select(Tweet.content, fn.COUNT(Favorite.id).alias('count'))
.join_from(Tweet, User) # Join tweet -> user.
.join_from(Tweet, Favorite, JOIN.LEFT_OUTER) # Join tweet -> favorite.
.where(User.username == 'huey')
.group_by(Tweet.content))
We can iterate over the results of the above query to print the tweet’s content and the favorite count:
>>> for tweet in query:
... print('%s favorited %d times' % (tweet.content, tweet.count))
...
meow favorited 1 times
hiss favorited 0 times
purr favorited 2 times
複数のソースから select する¶
If we wished to list all the tweets in the database, along with the username of their author, you might try writing this:
>>> for tweet in Tweet.select():
... print(tweet.user.username, '->', tweet.content)
...
huey -> meow
huey -> hiss
huey -> purr
mickey -> woof
mickey -> whine
There is a big problem with the above loop: it executes an additional query for
every tweet to look up the tweet.user
foreign-key. For our small table the
performance penalty isn’t obvious, but we would find the delays grew as the
number of rows increased.
If you’re familiar with SQL, you might remember that it’s possible to SELECT from multiple tables, allowing us to get the tweet content and the username in a single query:
SELECT tweet.content, user.username
FROM tweet
INNER JOIN user ON tweet.user_id = user.id;
Peewee makes this quite easy. In fact, we only need to modify our query a
little bit. We tell Peewee we wish to select Tweet.content
as well as
the User.username
field, then we include a join from tweet to user.
To make it a bit more obvious that it’s doing the correct thing, we can ask
Peewee to return the rows as dictionaries.
>>> for row in Tweet.select(Tweet.content, User.username).join(User).dicts():
... print(row)
...
{'content': 'meow', 'username': 'huey'}
{'content': 'hiss', 'username': 'huey'}
{'content': 'purr', 'username': 'huey'}
{'content': 'woof', 'username': 'mickey'}
{'content': 'whine', 'username': 'mickey'}
Now we’ll leave off the call to “.dicts()” and return the rows as Tweet
objects. Notice that Peewee assigns the username
value to
tweet.user.username
– NOT tweet.username
! Because there is a
foreign-key from tweet to user, and we have selected fields from both models,
Peewee will reconstruct the model-graph for us:
>>> for tweet in Tweet.select(Tweet.content, User.username).join(User):
... print(tweet.user.username, '->', tweet.content)
...
huey -> meow
huey -> hiss
huey -> purr
mickey -> woof
mickey -> whine
If we wish to, we can control where Peewee puts the joined User
instance in
the above query, by specifying an attr
in the join()
method:
>>> query = Tweet.select(Tweet.content, User.username).join(User, attr='author')
>>> for tweet in query:
... print(tweet.author.username, '->', tweet.content)
...
huey -> meow
huey -> hiss
huey -> purr
mickey -> woof
mickey -> whine
Conversely, if we simply wish all attributes we select to be attributes of
the Tweet
instance, we can add a call to objects()
at
the end of our query (similar to how we called dicts()
):
>>> for tweet in query.objects():
... print(tweet.username, '->', tweet.content)
...
huey -> meow
(etc)
より複雑な例¶
より複雑な例として、以下のクエリーでは、すべてのいいねといいねした人、 いいねされたツイート、そしてツイートした人を一回のクエリーで SELECT します。
以下のような SQL を書いてみました:
SELECT owner.username, tweet.content, author.username AS author
FROM favorite
INNER JOIN user AS owner ON (favorite.user_id = owner.id)
INNER JOIN tweet ON (favorite.tweet_id = tweet.id)
INNER JOIN user AS author ON (tweet.user_id = author.id);
ここで、user テーブルを2度 SELECT していることに注意が必要です - 一度目はいいねしたユーザという文脈、二度目はツイートの作者としてです。
Peewee では Model.alias()
を使ってモデルクラスのエイリアスを
作ることで、1つのクエリーの中で2回参照できるようになります:
Owner = User.alias()
query = (Favorite
.select(Favorite, Tweet.content, User.username, Owner.username)
.join(Owner) # Join favorite -> user (owner of favorite).
.switch(Favorite)
.join(Tweet) # Join favorite -> tweet
.join(User)) # Join tweet -> user
We can iterate over the results and access the joined values in the following way. Note how Peewee has resolved the fields from the various models we selected and reconstructed the model graph:
>>> for fav in query:
... print(fav.user.username, 'liked', fav.tweet.content, 'by', fav.tweet.user.username)
...
huey liked whine by mickey
mickey liked purr by huey
zaizee liked meow by huey
zaizee liked purr by huey
サブクエリー¶
Peewee allows you to join on any table-like object, including subqueries or common table expressions (CTEs). To demonstrate joining on a subquery, let’s query for all users and their latest tweet.
Here is the SQL:
SELECT tweet.*, user.*
FROM tweet
INNER JOIN (
SELECT latest.user_id, MAX(latest.timestamp) AS max_ts
FROM tweet AS latest
GROUP BY latest.user_id) AS latest_query
ON ((tweet.user_id = latest_query.user_id) AND (tweet.timestamp = latest_query.max_ts))
INNER JOIN user ON (tweet.user_id = user.id)
We’ll do this by creating a subquery which selects each user and the timestamp of their latest tweet. Then we can query the tweets table in the outer query and join on the user and timestamp combination from the subquery.
# Define our subquery first. We'll use an alias of the Tweet model, since
# we will be querying from the Tweet model directly in the outer query.
Latest = Tweet.alias()
latest_query = (Latest
.select(Latest.user, fn.MAX(Latest.timestamp).alias('max_ts'))
.group_by(Latest.user)
.alias('latest_query'))
# Our join predicate will ensure that we match tweets based on their
# timestamp *and* user_id.
predicate = ((Tweet.user == latest_query.c.user_id) &
(Tweet.timestamp == latest_query.c.max_ts))
# We put it all together, querying from tweet and joining on the subquery
# using the above predicate.
query = (Tweet
.select(Tweet, User) # Select all columns from tweet and user.
.join(latest_query, on=predicate) # Join tweet -> subquery.
.join_from(Tweet, User)) # Join from tweet -> user.
Iterating over the query, we can see each user and their latest tweet.
>>> for tweet in query:
... print(tweet.user.username, '->', tweet.content)
...
huey -> purr
mickey -> whine
There are a couple things you may not have seen before in the code we used to create the query in this section:
We used
join_from()
to explicitly specify the join context. We wrote.join_from(Tweet, User)
, which is equivalent to.switch(Tweet).join(User)
.We referenced columns in the subquery using the magic
.c
attribute, for examplelatest_query.c.max_ts
. The.c
attribute is used to dynamically create column references.Instead of passing individual fields to
Tweet.select()
, we passed theTweet
andUser
models. This is shorthand for selecting all fields on the given model.
一般的なテーブル表現¶
In the previous section we joined on a subquery, but we could just as easily have used a common-table expression (CTE). We will repeat the same query as before, listing users and their latest tweets, but this time we will do it using a CTE.
Here is the SQL:
WITH latest AS (
SELECT user_id, MAX(timestamp) AS max_ts
FROM tweet
GROUP BY user_id)
SELECT tweet.*, user.*
FROM tweet
INNER JOIN latest
ON ((latest.user_id = tweet.user_id) AND (latest.max_ts = tweet.timestamp))
INNER JOIN user
ON (tweet.user_id = user.id)
This example looks very similar to the previous example with the subquery:
# Define our CTE first. We'll use an alias of the Tweet model, since
# we will be querying from the Tweet model directly in the main query.
Latest = Tweet.alias()
cte = (Latest
.select(Latest.user, fn.MAX(Latest.timestamp).alias('max_ts'))
.group_by(Latest.user)
.cte('latest'))
# Our join predicate will ensure that we match tweets based on their
# timestamp *and* user_id.
predicate = ((Tweet.user == cte.c.user_id) &
(Tweet.timestamp == cte.c.max_ts))
# We put it all together, querying from tweet and joining on the CTE
# using the above predicate.
query = (Tweet
.select(Tweet, User) # Select all columns from tweet and user.
.join(cte, on=predicate) # Join tweet -> CTE.
.join_from(Tweet, User) # Join from tweet -> user.
.with_cte(cte))
We can iterate over the result-set, which consists of the latest tweets for each user:
>>> for tweet in query:
... print(tweet.user.username, '->', tweet.content)
...
huey -> purr
mickey -> whine
Note
For more information about using CTEs, including information on writing recursive CTEs, see the 共通のテーブル表現 section of the “Querying” document.
同じモデルに対する複数の外部キー¶
When there are multiple foreign keys to the same model, it is good practice to explicitly specify which field you are joining on.
Referring back to the example app’s models, consider the Relationship model, which is used to denote when one user follows another. Here is the model definition:
class Relationship(BaseModel):
from_user = ForeignKeyField(User, backref='relationships')
to_user = ForeignKeyField(User, backref='related_to')
class Meta:
indexes = (
# Specify a unique multi-column index on from/to-user.
(('from_user', 'to_user'), True),
)
Since there are two foreign keys to User, we should always specify which field we are using in a join.
For example, to determine which users I am following, I would write:
(User
.select()
.join(Relationship, on=Relationship.to_user)
.where(Relationship.from_user == charlie))
On the other hand, if I wanted to determine which users are following me, I would instead join on the from_user column and filter on the relationship’s to_user:
(User
.select()
.join(Relationship, on=Relationship.from_user)
.where(Relationship.to_user == charlie))
任意のフィールドに対する JOIN¶
If a foreign key does not exist between two tables you can still perform a join, but you must manually specify the join predicate.
In the following example, there is no explicit foreign-key between User and
ActivityLog, but there is an implied relationship between the
ActivityLog.object_id field and User.id. Rather than joining on a specific
Field
, we will join using an Expression
.
user_log = (User
.select(User, ActivityLog)
.join(ActivityLog, on=(User.id == ActivityLog.object_id), attr='log')
.where(
(ActivityLog.activity_type == 'user_activity') &
(User.username == 'charlie')))
for user in user_log:
print(user.username, user.log.description)
#### Print something like ####
charlie logged in
charlie posted a tweet
charlie retweeted
charlie posted a tweet
charlie logged out
Note
Recall that we can control the attribute Peewee will assign the joined
instance to by specifying the attr
parameter in the join()
method.
In the previous example, we used the following join:
join(ActivityLog, on=(User.id == ActivityLog.object_id), attr='log')
Then when iterating over the query, we were able to directly access the joined ActivityLog without incurring an additional query:
for user in user_log:
print(user.username, user.log.description)
自己 JOIN¶
Peewee supports constructing queries containing a self-join.
モデルの別名を使う¶
To join on the same model (table) twice, it is necessary to create a model alias to represent the second instance of the table in a query. Consider the following model:
class Category(Model):
name = CharField()
parent = ForeignKeyField('self', backref='children')
What if we wanted to query all categories whose parent category is Electronics. One way would be to perform a self-join:
Parent = Category.alias()
query = (Category
.select()
.join(Parent, on=(Category.parent == Parent.id))
.where(Parent.name == 'Electronics'))
When performing a join that uses a ModelAlias
, it is necessary to
specify the join condition using the on
keyword argument. In this case we
are joining the category with its parent category.
サブクエリーを使う¶
Another less common approach involves the use of subqueries. Here is another way we might construct a query to get all the categories whose parent category is Electronics using a subquery:
Parent = Category.alias()
join_query = Parent.select().where(Parent.name == 'Electronics')
# Subqueries used as JOINs need to have an alias.
join_query = join_query.alias('jq')
query = (Category
.select()
.join(join_query, on=(Category.parent == join_query.c.id)))
This will generate the following SQL query:
SELECT t1."id", t1."name", t1."parent_id"
FROM "category" AS t1
INNER JOIN (
SELECT t2."id"
FROM "category" AS t2
WHERE (t2."name" = ?)) AS jq ON (t1."parent_id" = "jq"."id")
To access the id
value from the subquery, we use the .c
magic lookup
which will generate the appropriate SQL expression:
Category.parent == join_query.c.id
# Becomes: (t1."parent_id" = "jq"."id")
Many to Many を実装する¶
Peewee provides a field for representing many-to-many relationships, much like Django does. This feature was added due to many requests from users, but I strongly advocate against using it, since it conflates the idea of a field with a junction table and hidden joins. It’s just a nasty hack to provide convenient accessors.
To implement many-to-many correctly with peewee, you will therefore create the intermediary table yourself and query through it:
class Student(Model):
name = CharField()
class Course(Model):
name = CharField()
class StudentCourse(Model):
student = ForeignKeyField(Student)
course = ForeignKeyField(Course)
To query, let’s say we want to find students who are enrolled in math class:
query = (Student
.select()
.join(StudentCourse)
.join(Course)
.where(Course.name == 'math'))
for student in query:
print(student.name)
To query what classes a given student is enrolled in:
courses = (Course
.select()
.join(StudentCourse)
.join(Student)
.where(Student.name == 'da vinci'))
for course in courses:
print(course.name)
To efficiently iterate over a many-to-many relation, i.e., list all students
and their respective courses, we will query the through model
StudentCourse
and precompute the Student and Course:
query = (StudentCourse
.select(StudentCourse, Student, Course)
.join(Course)
.switch(StudentCourse)
.join(Student)
.order_by(Student.name))
To print a list of students and their courses you might do the following:
for student_course in query:
print(student_course.student.name, '->', student_course.course.name)
Since we selected all fields from Student
and Course
in the select
clause of the query, these foreign key traversals are “free” and we’ve done the
whole iteration with just 1 query.
ManyToManyField¶
The ManyToManyField
provides a field-like API over many-to-many
fields. For all but the simplest many-to-many situations, you’re better off
using the standard peewee APIs. But, if your models are very simple and your
querying needs are not very complex, ManyToManyField
may work.
Modeling students and courses using ManyToManyField
:
from peewee import *
db = SqliteDatabase('school.db')
class BaseModel(Model):
class Meta:
database = db
class Student(BaseModel):
name = CharField()
class Course(BaseModel):
name = CharField()
students = ManyToManyField(Student, backref='courses')
StudentCourse = Course.students.get_through_model()
db.create_tables([
Student,
Course,
StudentCourse])
# Get all classes that "huey" is enrolled in:
huey = Student.get(Student.name == 'Huey')
for course in huey.courses.order_by(Course.name):
print(course.name)
# Get all students in "English 101":
engl_101 = Course.get(Course.name == 'English 101')
for student in engl_101.students:
print(student.name)
# When adding objects to a many-to-many relationship, we can pass
# in either a single model instance, a list of models, or even a
# query of models:
huey.courses.add(Course.select().where(Course.name.contains('English')))
engl_101.students.add(Student.get(Student.name == 'Mickey'))
engl_101.students.add([
Student.get(Student.name == 'Charlie'),
Student.get(Student.name == 'Zaizee')])
# The same rules apply for removing items from a many-to-many:
huey.courses.remove(Course.select().where(Course.name.startswith('CS')))
engl_101.students.remove(huey)
# Calling .clear() will remove all associated objects:
cs_150.students.clear()
Attention
Before many-to-many relationships can be added, the objects being referenced will need to be saved first. In order to create relationships in the many-to-many through table, Peewee needs to know the primary keys of the models being referenced.
Warning
It is strongly recommended that you do not attempt to subclass models
containing ManyToManyField
instances.
A ManyToManyField
, despite its name, is not a field in the
usual sense. Instead of being a column on a table, the many-to-many field
covers the fact that behind-the-scenes there’s actually a separate table
with two foreign-key pointers (the through table).
Therefore, when a subclass is created that inherits a many-to-many field, what actually needs to be inherited is the through table. Because of the potential for subtle bugs, Peewee does not attempt to automatically subclass the through model and modify its foreign-key pointers. As a result, many-to-many fields typically will not work with inheritance.
For more examples, see:
N+1 問題の回避¶
The N+1 problem refers to a situation where an application performs a query, then for each row of the result set, the application performs at least one other query (another way to conceptualize this is as a nested loop). In many cases, these n queries can be avoided through the use of a SQL join or subquery. The database itself may do a nested loop, but it will usually be more performant than doing n queries in your application code, which involves latency communicating with the database and may not take advantage of indices or other optimizations employed by the database when joining or executing a subquery.
Peewee provides several APIs for mitigating N+1 query behavior. Recollecting the models used throughout this document, User and Tweet, this section will try to outline some common N+1 scenarios, and how peewee can help you avoid them.
Attention
In some cases, N+1 queries will not result in a significant or measurable performance hit. It all depends on the data you are querying, the database you are using, and the latency involved in executing queries and retrieving results. As always when making optimizations, profile before and after to ensure the changes do what you expect them to.
最新のツイート一覧¶
The twitter timeline displays a list of tweets from multiple users. In addition to the tweet’s content, the username of the tweet’s author is also displayed. The N+1 scenario here would be:
Fetch the 10 most recent tweets.
For each tweet, select the author (10 queries).
By selecting both tables and using a join, peewee makes it possible to accomplish this in a single query:
query = (Tweet
.select(Tweet, User) # Note that we are selecting both models.
.join(User) # Use an INNER join because every tweet has an author.
.order_by(Tweet.id.desc()) # Get the most recent tweets.
.limit(10))
for tweet in query:
print(tweet.user.username, '-', tweet.message)
Without the join, accessing tweet.user.username
would trigger a query to
resolve the foreign key tweet.user
and retrieve the associated user. But
since we have selected and joined on User
, peewee will automatically
resolve the foreign-key for us.
Note
This technique is discussed in more detail in 複数のソースから select する.
ユーザとそれらのツイートのリスト¶
Let’s say you want to build a page that shows several users and all of their tweets. The N+1 scenario would be:
Fetch some users.
For each user, fetch their tweets.
This situation is similar to the previous example, but there is one important difference: when we selected tweets, they only have a single associated user, so we could directly assign the foreign key. The reverse is not true, however, as one user may have any number of tweets (or none at all).
Peewee provides an approach to avoiding O(n) queries in this situation. Fetch users first, then fetch all the tweets associated with those users. Once peewee has the big list of tweets, it will assign them out, matching them with the appropriate user. This method is usually faster but will involve a query for each table being selected.
プリフェッチを使う¶
peewee supports pre-fetching related data using sub-queries. This method
requires the use of a special API, prefetch()
. Prefetch, as its name
implies, will eagerly load the appropriate tweets for the given users using
subqueries. This means instead of O(n) queries for n rows, we will do
O(k) queries for k tables.
Here is an example of how we might fetch several users and any tweets they created within the past week.
week_ago = datetime.date.today() - datetime.timedelta(days=7)
users = User.select()
tweets = (Tweet
.select()
.where(Tweet.timestamp >= week_ago))
# This will perform two queries.
users_with_tweets = prefetch(users, tweets)
for user in users_with_tweets:
print(user.username)
for tweet in user.tweets:
print(' ', tweet.message)
Note
Note that neither the User
query, nor the Tweet
query contained a
JOIN clause. When using prefetch()
you do not need to specify the
join.
prefetch()
can be used to query an arbitrary number of tables. Check
the API documentation for more examples.
Some things to consider when using prefetch()
:
Foreign keys must exist between the models being prefetched.
LIMIT works as you’d expect on the outer-most query, but may be difficult to implement correctly if trying to limit the size of the sub-selects.