Segmenting Data by Location按位置分割数据

On this page本页内容

In sharded clusters, you can create zones of sharded data based on the shard key. 在分片集群中,可以基于分片键创建分片数据区域You can associate each zone with one or more shards in the cluster. 您可以将每个分区与集群中的一个或多个分片相关联。A shard can associate with any number of zones. 分片可以与任意数量的区域关联。In a balanced cluster, MongoDB migrates chunks covered by a zone only to those shards associated with the zone.在平衡集群中,MongoDB只将区域覆盖的迁移到与该区域关联的分片。

Tip提示

Changed in version 4.0.3.在版本4.0.3中更改

By defining the zones and the zone ranges before sharding an empty or a non-existing collection, the shard collection operation creates chunks for the defined zone ranges as well as any additional chunks to cover the entire range of the shard key values and performs an initial chunk distribution based on the zone ranges. 通过在对空集合或不存在的集合进行分片之前定义区域和区域范围,分片集合操作为定义的区域范围以及覆盖整个分片键值范围的任何附加块创建块,并基于区域范围执行初始块分布。This initial creation and distribution of chunks allows for faster setup of zoned sharding. 块的初始创建和分布允许更快地设置分区分片。After the initial distribution, the balancer manages the chunk distribution going forward.在初始分发之后,平衡器将继续管理块分发。See Pre-Define Zones and Zone Ranges for an Empty or Non-Existing Collection for an example.有关示例,请参阅为空集合或不存在集合预定义区域和区域范围

This tutorial uses Zones to segment data based on geographic area.本教程使用分区根据地理区域分割数据。

The following are some example use cases for segmenting data by geographic area:以下是按地理区域划分数据的一些示例用例:

The following diagram illustrates a sharded cluster that uses geographic based zones to manage and satisfy data segmentation requirements.下图说明了一个分片集群,该集群使用基于地理的区域来管理和满足数据分割要求。

Diagram geo distribution based on zones

Scenario脚本

A financial chat application logs messages, tracking the country of the originating user. 金融聊天应用程序记录消息,跟踪发起用户的国家。The application stores the logs in the chat database under the messages collection. 应用程序将日志存储在chat数据库的messages集合下。The chats contain information that must be segmented by country to have servers local to the country serve read and write requests for the country's users. 聊天包含的信息必须按国家分类,以使该国本地的服务器为该国用户提供读写请求。A group of countries can be assigned same zone in order to share resources.可以将一组国家分配到同一区域,以共享资源。

The application currently has users in the US, UK, and Germany. 该应用程序目前在美国、英国和德国拥有用户。The country field represents the user's country based on its ISO 3166-1 Alpha-2 two-character country codes.country字段表示基于ISO 3166-1 Alpha-2两字符国家代码的用户国家。

The following documents represent a partial view of three chat messages:以下文档显示了三条聊天信息的部分视图:

{
  "_id" : ObjectId("56f08c447fe58b2e96f595fa"),
  "country" : "US",
  "userid" : 123,
  "message" : "Hello there",
  ...,
}
{
  "_id" : ObjectId("56f08c447fe58b2e96f595fb"),
  "country" : "UK",
  "userid" : 456,
  "message" : "Good Morning"
  ...,
}
{
  "_id" : ObjectId("56f08c447fe58b2e96f595fc"),
  "country" : "DE",
  "userid" : 789,
  "message" : "Guten Tag"
  ...,
}

Shard Key分片键

The messages collection uses the { country : 1, userid : 1 } compound index as the shard key.messages集合使用{ country : 1, userid : 1 }复合索引作为分片键。

The country field in each document allows for creating a zone for each distinct country value.每个文档中的country字段允许为每个不同的国家值创建一个区域。

The userid field provides a high cardinality and low frequency component to the shard key relative to country.userid字段为分片键提供了相对于国家的高基数和低频率分量。

See Choosing a Shard Key for more general instructions on selecting a shard key.有关选择分片键的更多一般说明,请参阅选择分片键

Architecture建筑学

The sharded cluster has shards in two data centers - one in Europe, and one in North America.分片集群在两个数据中心有分片-一个在欧洲,一个在北美。

Diagram of zones used for supporting geo distribution architecture

Zones区域

This application requires one zone per data center.此应用程序要求每个数据中心有一个区域。

EU - European data center欧洲数据中心

Shards deployed on this data center are assigned to the EU zone.部署在此数据中心上的分片被分配到欧盟EU区域。

For each country using the EU data center for local reads and writes, create a zone range for the EU zone with:对于使用EU数据中心进行本地读写的每个国家,使用以下内容为EU区域创建区域范围:

  • a lower bound of { "country" : <country>, "userid" : MinKey }的下界
  • an upper bound of { "country" : <country>, "userid" : MaxKey }的上界
NA - North American data center北美数据中心

Shards deployed on this data center are assigned to the NA zone.部署在此数据中心上的分片被分配到NA区域。

For each country using the NA data center for local reads and writes, create a zone range for the NA zone with:对于使用NA数据中心进行本地读写的每个国家/地区,使用以下内容为NA区域创建区域范围:

  • a lower bound of { "country" : <country>, "userid" : MinKey }的下界
  • an upper bound of { "country" : <country>, "userid" : MaxKey }的上界
Note注意

The MinKey and MaxKey values are reserved special values for comparisonsMinKeyMaxKey值是为比较保留的特殊值

Write Operations写操作

With zones, if an inserted or updated document matches a configured zone, it can only be written to a shard inside of that zone.对于区域,如果插入或更新的文档与配置的区域匹配,则只能将其写入该区域内的分片。

MongoDB can write documents that do not match a configured zone to any shard in the cluster.MongoDB可以编写与集群中任何分片的配置区域不匹配的文档。

Note注意

The behavior described above requires the cluster to be in a steady state with no chunks violating a configured zone. 上述行为要求集群处于稳定状态,没有块违反配置区域。See the following section on the balancer for more information.有关更多信息,请参阅以下关于平衡器的章节。

Read Operations读操作

MongoDB can route queries to a specific shard if the query includes at least the country field.如果查询至少包括country字段,MongoDB可以将查询路由到特定的分片。

For example, MongoDB can attempt a targeted read operation on the following query:例如,MongoDB可以尝试对以下查询执行目标读取操作

chatDB = db.getSiblingDB("chat")
chatDB.messages.find( { "country" : "UK" , "userid" : "123" } )

Queries without the country field perform broadcast operations.没有country字段的查询执行广播操作

Balancer平衡器

The balancer migrates chunks to the appropriate shard respecting any configured zones. 平衡器将块迁移到与任何配置区域相关的适当分片。Until the migration, shards may contain chunks that violate configured zones. 在迁移之前,分片可能包含违反配置区域的块。Once balancing completes, shards should only contain chunks whose ranges do not violate its assigned zones.一旦平衡完成,分片应该只包含其范围不违反其分配区域的块。

Adding or removing zones or zone ranges can result in chunk migrations. 添加或删除区域或区域范围可能导致块迁移。Depending on the size of your data set and the number of chunks a zone or zone range affects, these migrations may impact cluster performance. 根据数据集的大小以及区域或区域范围影响的块数,这些迁移可能会影响群集性能。Consider running your balancer during specific scheduled windows. 考虑在特定的计划窗口期间运行平衡器See Schedule the Balancing Window for a tutorial on how to set a scheduling window.有关如何设置计划窗口的教程,请参阅计划平衡窗口

Security安全

For sharded clusters running with Role-Based Access Control, authenticate as a user with at least the clusterManager role on the admin database.对于使用基于角色的访问控制运行的分片集群,至少使用admin数据库上的clusterManager角色作为用户进行身份验证。

Procedure过程

You must be connected to a mongos to create zones and zone ranges. 您必须连接到mongos才能创建区域和区域范围。You cannot create zones or zone ranges by connecting directly to a shard.无法通过直接连接到分片来创建分区或分区范围。

1

Disable the Balancer (Optional)禁用平衡器(可选)

To reduce performance impacts, the balancer may be disabled on the collection to ensure no migrations take place while configuring the new zones.为了减少性能影响,可以在集合上禁用平衡器,以确保在配置新区域时不会发生迁移。

Use sh.disableBalancing(), specifying the namespace of the collection, to stop the balancer.使用sh.disableBalancing(),指定集合的命名空间,以停止平衡器。

sh.disableBalancing("chat.message")

Use sh.isBalancerRunning() to check if the balancer process is currently running. 使用sh.isBalancerRunning()检查平衡器进程当前是否正在运行。Wait until any current balancing rounds have completed before proceeding.在继续之前,请等待所有当前平衡轮完成。

2

Add each shard to the appropriate zone将每个分片添加到相应的分区

Add each shard in the North American data center to the NA zone.将北美数据中心中的每个分片添加到NA区域。

sh.addShardTag(<shard name>, "NA")

Add each shard in the European data center to the EU zone.将欧洲数据中心中的每个分片添加到EU区域。

sh.addShardTag(<shard name>, "EU")

You can review the zones assigned to any given shard by running sh.status().您可以通过运行sh.status()查看分配给任何给定分片的区域。

3

Define ranges for each zone定义每个区域的范围

For shard key values where country : US, define a shard key range and associate it to the NA zone using the sh.addTagRange() method. 对于其中country: US的分片键值,定义一个分片键范围,并使用sh.addTagRange()方法将其与NA区域关联。This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.addTagRange(
  "chat.messages",
  { "country" : "US", "userid" : MinKey },
  { "country" : "US", "userid" : MaxKey }, 
  "NA"
)

For shard key values where country : UK, define a shard key range and associate it to the EU zone using the sh.addTagRange() method. 对于country: UK的分片键值,定义一个分片键范围,并使用sh.addTagRange()方法将其与EU区域关联。This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.addTagRange(
  "chat.messages",
  { "country" : "UK", "userid" : MinKey },
  { "country" : "UK", "userid" : MaxKey }, 
  "EU"
)

For shard key values where country : DE, define a shard key range and associate it to the EU zone using the sh.addTagRange() method. 对于country: DE的分片键值,定义一个分片键范围,并使用sh.addTagRange()方法将其与EU区域关联。This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.addTagRange(
  "chat.messages",
  { "country" : "DE", "userid" : MinKey },
  { "country" : "DE", "userid" : MaxKey }, 
  "EU"
)

The MinKey and MaxKey values are reserved special value for comparisons. MinKeyMaxKey值是为比较保留的特殊值。MinKey always compares as lower than every other possible value, while MaxKey always compares as higher than every other possible value. 总是比其他所有可能的值低,而MaxKey总是比其他可能的值高。The configured ranges captures every user for each device.配置的范围捕获每个device的每个用户。

Both country : UK and country : DE are assigned to the EU zone. country : UKcountry : DE都被分配到EU区。This associates any document with either UK or DE as the value for country to the EU data center.这会将任何文档与UKDE关联,作为欧盟数据中心的country值。

4

Enable the Balancer (Optional)启用平衡器(可选)

If the balancer was disabled in previous steps, re-enable the balancer at the completion of this procedure to rebalance the cluster.如果在前面的步骤中禁用了平衡器,请在完成此过程时重新启用平衡器以重新平衡群集。

Use sh.enableBalancing(), specifying the namespace of the collection, to start the balancer.使用sh.enableBalancing(),指定集合的命名空间,以启动平衡器。

sh.enableBalancing("chat.message")

Use sh.isBalancerRunning() to check if the balancer process is currently running.使用sh.isBalancerRunning()检查平衡器进程当前是否正在运行。

5

Review the Changes回顾变化

The next time the balancer runs, it splits chunks where necessary and migrates chunks across the shards respecting the configured zones.下一次运行平衡器时,它会在必要时分割块,并根据配置的区域跨分片迁移块。

Once balancing finishes:平衡完成后:

  • shards in the NA zone should only contain documents with country : US, andNA区域中的分片应仅包含country : US的文档,并且
  • shards in the EU zone should only contain documents with country : UK or country : DE.EU区中的分片应仅包含country : UKcountry : DE

A document with a value for country other than US, UK, or DE can reside on any shard in the cluster.具有除USUKDE之外的country值的文档可以驻留在集群中的任何分片上。

To confirm the chunk distribution, run sh.status().要确认区块分布,请运行sh.status()

Updating Zones更新区域

The application requires the following updates:应用程序需要以下更新:

  • Documents with country : UK must now be associated to the new UK data center. country : UK的文档现在必须与新的英国数据中心关联。Any data in the EU data center must be migrated必须迁移EU数据中心中的任何数据
  • The chat application now supports users in Mexico. 聊天应用程序现在支持墨西哥的用户。Documents with country : MX must be routed to the NA data center.country : MX的文档必须发送到NA数据中心。

Perform the following procedures to update the zone ranges.执行以下步骤以更新分区范围。

1

Disable the Balancer (Optional)禁用平衡器(可选)

To reduce performance impacts, the balancer may be disabled on the collection to ensure no migrations take place while configuring the new zones or removing the old ones.为了降低性能影响,可以在集合上禁用平衡器,以确保在配置新区域或删除旧区域时不会发生迁移。

Use sh.disableBalancing(), specifying the namespace of the collection, to stop the balancer使用sh.disableBalancing(),指定集合的命名空间,以停止平衡器

sh.disableBalancing("chat.messages")

Use sh.isBalancerRunning() to check if the balancer process is currently running. 使用sh.isBalancerRunning()检查平衡器进程当前是否正在运行。Wait until any current balancing rounds have completed before proceeding.在继续之前,请等待所有当前平衡轮完成。

2

Add the new UK zone添加新的UK

Add each shard in the UK data center to the UK zone.UK数据中心中的每个分片添加到UK区域。

sh.addShardTag("<shard name>", "UK")

You can review the zones assigned to any given shard by running sh.status().您可以通过运行sh.status()查看分配给任何给定分片的区域。

3

Remove the old zone range删除旧区域范围

Remove the old zone range associated to the UK country using the sh.removeTagRange() method. 使用sh.removeTagRange()方法删除与UK国家关联的旧区域范围。This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.removeTagRange(
  "chat.messages",
  { "country" : "UK", "userid" : MinKey },
  { "country" : "UK", "userid" : MaxKey }
  "EU"
)
4

Add new zone ranges添加新的区域范围

For shard key values where country : UK, define a shard key range and associate it to the UK zone using the sh.addTagRange() method. 对于其中country : UK的分片键值,定义一个分片键值范围,并使用sh.addTagRange()方法将其与UK区域关联。This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.addTagRange(
  "chat.message",
  { "country" : "UK", "userid" : MinKey },
  { "country" : "UK", "userid" : MaxKey }, 
  "UK"
)

For shard key values where country : MX, define a shard key range and associate it to the NA zone using the sh.addTagRange() method.对于country : MX的分片键值,定义一个分片键范围,并使用sh.addTagRange()方法将其与NA区域关联。 This method requires:该方法要求:

  • The full namespace of the target collection.目标集合的完整命名空间。
  • The inclusive lower bound of the range.范围的包含下限。
  • The exclusive upper bound of the range.范围的唯一上界。
  • The name of the zone.区域的名称。
sh.addTagRange(
  "chat.messages",
  { "country" : "MX", "userid" : MinKey },
  { "country" : "MX", "userid" : MaxKey }, 
  "NA"
)

The MinKey and MaxKey values are reserved special values for comparisons. MinKeyMaxKey值是为比较保留的特殊值。MinKey always compares as lower than every other possible value, while 总是比其他可能的值低,而MaxKey always compares as higher than every other possible value. 总是比任何其他可能的值都高。This ensures the two ranges captures the entire possible value space of creation_date.这确保了两个范围捕获creation_date的整个可能值空间。

5

Enable the Balancer (Optional)启用平衡器(可选)

If the balancer was disabled in previous steps, re-enable the balancer at the completion of this procedure to rebalance the cluster.如果在前面的步骤中禁用了平衡器,请在完成此过程时重新启用平衡器以重新平衡群集。

Use sh.enableBalancing(), specifying the namespace of the collection, to start the balancer使用sh.enableBalancing(),指定集合的命名空间,以启动平衡器

sh.enableBalancing("chat.messages")

Use sh.isBalancerRunning() to check if the balancer process is currently running.使用sh.isBalancerRunning()检查平衡器进程当前是否正在运行。

←  Manage Shard ZonesTiered Hardware for Varying SLA or SLO →