此内容没有您所选择的语言版本。
Setting Up Cross-Site Replication
Data Grid Documentation
Abstract
Chapter 1. Red Hat Data Grid 复制链接链接已复制到粘贴板!
Data Grid is a high-performance, distributed in-memory data store.
- Schemaless data structure
- Flexibility to store different objects as key-value pairs.
- Grid-based data storage
- Designed to distribute and replicate data across clusters.
- Elastic scaling
- Dynamically adjust the number of nodes to meet demand without service disruption.
- Data interoperability
- Store, retrieve, and query data in the grid from different endpoints.
1.1. Data Grid Documentation 复制链接链接已复制到粘贴板!
Documentation for Data Grid is available on the Red Hat customer portal.
1.2. Data Grid Downloads 复制链接链接已复制到粘贴板!
Access the Data Grid Software Downloads on the Red Hat customer portal.
You must have a Red Hat account to access and download Data Grid software.
Chapter 2. Data Grid Cross-Site Replication 复制链接链接已复制到粘贴板!
Cross-site replication allows you to back up data from one Data Grid cluster to another.
2.1. Cross-Site Replication 复制链接链接已复制到粘贴板!
Data Grid clusters running in different locations can discover and communicate with each other.
A site is a locally running Data Grid cluster. For demonstration purposes, this documentation illustrates sites as data centers in different geographic locations, as in the following diagram:
LON is a datacenter in London, England.
NYC is a datacenter in New York City, USA.
Data Grid can form global clusters across two or more sites.
For example, configure a third Data Grid cluster running in San Francisco, SFO, as backup location for LON and NYC.
2.1.1. Site Masters 复制链接链接已复制到粘贴板!
Site masters are the nodes in Data Grid clusters that are responsible for sending and receiving requests from backup locations.
If a node is not a site master, it must forward backup requests to a local site master. Only site masters can send requests to backup locations.
For optimal performance, you should configure all nodes as site masters. This increases the speed of backup requests because each node in the cluster can backup to remote sites directly without having to forward backup requests to site masters.
2.2. Adding Backups to Caches 复制链接链接已复制到粘贴板!
Name remote sites as backup locations in your cache definitions.
For example, the following diagram shows three caches, "customers", "eu-orders", and "us-orders":
- In LON, "customers" names NYC as a backup location.
- In NYC, "customers" names LON as a backup location.
- "eu-orders" and "us-orders" do not have backups and are local to the respective cluster.
2.3. Backup Strategies 复制链接链接已复制到粘贴板!
Data Grid clusters can use different strategies for backing up data to remote sites.
Data Grid replicates across sites at the same time that writes to local caches occur. For example, if a client writes "k1" to LON, Data Grid backs up "k1" to NYC at the same time.
2.3.1. Synchronous Backups 复制链接链接已复制到粘贴板!
When Data Grid replicates data to backup locations, it waits until the operation completes before writing to the local cache.
You can control how Data Grid handles writes to the local cache if backup operations fail. For example, you can configure Data Grid to attempt to abort local writes and throw exceptions if backups to remote sites fail.
Synchronous backups also support two-phase commits with caches that participate in optimistic transactions. The first phase of the backup acquires a lock. The second phase commits the modification.
Two-phase commit with cross-site replication has a significant performance impact because it requires two round-trips across the network.
2.3.2. Asynchronous Backups 复制链接链接已复制到粘贴板!
When Data Grid replicates data to backup locations, it does not wait until the operation completes before writing to the local cache.
Asynchronous backup operations and writes to the local cache are independent of each other. If backup operations fail, write operations to the local cache continue and no exceptions occur.
2.3.3. Synchronous vs Asynchronous Backups 复制链接链接已复制到粘贴板!
Synchronous backups offer the strongest guarantee of data consistency across sites. If strategy=sync, when cache.put() calls return you know the value is up to date in the local cache and in the backup locations.
The trade-off for this consistency is performance. Synchronous backups have much greater latency in comparison to asynchronous backups.
Asynchronous backups, on the other hand, do not add latency to client requests so they have no performance impact. However, if strategy=async, when cache.put() calls return you cannot be sure of the value in the backup locations is the same as in the local cache.
2.4. Taking Sites Offline Automatically 复制链接链接已复制到粘贴板!
Backup configurations include timeout values for operations to replicate data to remote sites. When backup operations reach the timeout, Data Grid records the operation as a failure.
To automatically take sites offline, you can then configure the number of consecutive failures that can occur.
For example, the NYC backup configuration specifies five as the number of failures after which NYC goes offline. If LON attempts five consecutive backup operations that fail, Data Grid automatically takes NYC offline. LON then stops backing up to NYC until you bring the site back online.
<backup site="NYC" strategy="ASYNC"> <take-offline after-failures="5"/> </backup>
<backup site="NYC" strategy="ASYNC">
<take-offline after-failures="5"/>
</backup>
You can also specify the amount of time to wait before taking sites offline. When backup operations fail, Data Grid waits before taking sites offline. If a backup request succeeds before the wait time runs out, Data Grid does not take the site offline.
<backup site="NYC" strategy="ASYNC">
<take-offline after-failures="5"
min-wait="10000"/>
</backup>
<backup site="NYC" strategy="ASYNC">
<take-offline after-failures="5"
min-wait="10000"/>
</backup>
In the preceding example, if failures occur for 5 consecutive operations, Data Grid waits 10 seconds and, if no requests are successful within the 10 second wait time, Data Grid then takes NYC offline.
To use only a minimum wait time for automatically taking locations offline, set a negative or zero value for the after-failures attribute; for example:
<backup site="NYC" strategy="ASYNC">
<take-offline after-failures="-1"
min-wait="10000"/>
</backup>
<backup site="NYC" strategy="ASYNC">
<take-offline after-failures="-1"
min-wait="10000"/>
</backup>
You can manually take sites offline through the Data Grid command line interface or REST API.
2.5. State Transfer 复制链接链接已复制到粘贴板!
State transfer is an administrative operation that synchronizes data between sites.
For example, LON goes offline and NYC starts handling client requests. When you bring LON back online, the Data Grid cluster in LON does not have the same data as the cluster in NYC.
To ensure the data is consistent between LON and NYC, you can push state from NYC to LON.
- State transfer is bidirectional. For example, you can push state from NYC to LON or from LON to NYC.
- Pushing state to offline sites brings them back online.
State transfer overwrites only data that exists on both sites, the originating site and the receiving site. Data Grid does not delete data.
For example, "k2" exists on LON and NYC. "k2" is removed from NYC while LON is offline. When you bring LON back online, "k2" still exists at that location. If you push state from NYC to LON, the transfer does not affect "k2" on LON.
TipTo ensure contents of the cache are identical after state transfer, remove all data from the cache on the receiving site before pushing state. Use the
clear()method.State transfer does not overwrite updates to data that occur after you initiate the push.
For example, "k1,v1" exists on LON and NYC. LON goes offline so you push state transfer to LON from NYC, which brings LON back online. Before state transfer completes, a client puts "k1,v2" on LON.
In this case the state transfer from NYC does not overwrite "k1,v2" because that modification happened after you initiated the push.
Reference
- org.infinispan.Cache.clear()
- Tip
Run
help clearcachefrom the CLI for command details and examples. - Clearing Caches with the REST API
2.6. Client Connections Across Sites 复制链接链接已复制到粘贴板!
Clients can write to Data Grid clusters in either an Active/Passive or Active/Active configuration.
Active/Passive
The following diagram illustrates Active/Passive where Data Grid handles client requests from one site only:
In the preceding image:
- Client connects to the Data Grid cluster at LON.
- Client writes "k1" to the cache.
- The site master at LON, "n1", sends the request to replicate "k1" to the site master at NYC, "nA".
With Active/Passive, NYC provides data redundancy. If the Data Grid cluster at LON goes offline for any reason, clients can start sending requests to NYC. When you bring LON back online you can synchronize data with NYC and then switch clients back to LON.
Active/Active
The following diagram illustrates Active/Active where Data Grid handles client requests at two sites:
In the preceding image:
- Client A connects to the Data Grid cluster at LON.
- Client A writes "k1" to the cache.
- Client B connects to the Data Grid cluster at NYC.
- Client B writes "k2" to the cache.
- Site masters at LON and NYC send requests so that "k1" is replicated to NYC and "k2" is replicated to LON.
With Active/Active both NYC and LON replicate data to remote caches while handling client requests. If either NYC or LON go offline, clients can start sending requests to the online site. You can then bring offline sites back online, push state to synchronize data, and switch clients as required.
2.6.1. Conflicting Entries with Cross-Site Replication 复制链接链接已复制到粘贴板!
Conflicting entries can occur with Active/Active site configurations if clients write to the same entries at the same time but at different sites.
For example, client A writes to "k1" in LON at the same time that client B writes to "k1" in NYC. In this case, "k1" has a different value in LON than in NYC.
With synchronous replication, concurrent writes result in deadlocks because both sites lock the same key in different orders. To resolve deadlocks, client applications must wait until the locks time out.
With asynchronous replication, concurrent writes result in conflicting values because sites replicate after entries are modified locally. After replication occurs, there is no guarantee which value for "k1" exists at which site.
- Keys have conflicting values.
- One of the conflicting values is overwritten if sites do not replicate values at the same time. In this case, one of the values is lost and there is no guarantee which value is saved.
In all cases, inconsistencies in key values are resolved after the next non-conflicting put() operation updates the value.
There currently is no conflict resolution policy that client applications can use to handle conflicts in asynchronous mode. However, conflict resolution techniques are planned for a future Data Grid version.
2.7. Expiration and Cross-Site Replication 复制链接链接已复制到粘贴板!
Data Grid expiration controls how long entries remain in the cache.
-
lifespanexpiration is suitable for cross-site replication. When entries reach the maximum lifespan, Data Grid expires them independently of the remote sites. -
max-idleexpiration does not work with cross-site replication. Data Grid cannot determine when cache entries reach the idle timeout in remote sites.
Configuring Data Grid to replicate data across sites, you first set up cluster transport so Data Grid clusters can discover each other and site masters can communicate. You then add backup locations to cache definitions in your Data Grid configuration.
Add JGroups RELAY2 to your transport layer so that Data Grid clusters can communicate with backup locations.
Procedure
-
Open
infinispan.xmlfor editing. Add the RELAY2 protocol to a JGroups stack, for example:
Copy to Clipboard Copied! Toggle word wrap Toggle overflow Configure Data Grid cluster transport to use the stack, as in the following example:
<cache-container name="default" statistics="true"> <transport cluster="${cluster.name}" stack="xsite"/> </cache-container><cache-container name="default" statistics="true"> <transport cluster="${cluster.name}" stack="xsite"/> </cache-container>Copy to Clipboard Copied! Toggle word wrap Toggle overflow -
Save and close
infinispan.xml.
3.1.1. JGroups RELAY2 Stacks 复制链接链接已复制到粘贴板!
Data Grid clusters use JGroups RELAY2 for inter-cluster discovery and communication.
- 1
- Defines a stack named "xsite" that declares which protocols to use for your Data Grid cluster transport.
- 2
- Uses the default JGroups UDP stack for intra-cluster traffic.
- 3
- Adds
RELAY2to the stack for inter-cluster transport. - 4
- Names the local site. Data Grid replicates data in caches from this site to backup locations.
- 5
- Configures a maximum of 1000 site masters for the local cluster. You should set
max_site_masters>= the number of nodes in the Data Grid cluster for optimal performance with backup requests. - 6
- Specifies all site names and uses the default JGroups TCP stack for inter-cluster transport.
- 7
- Names each remote site as a backup location.
3.1.2. Custom JGroups RELAY2 Stacks 复制链接链接已复制到粘贴板!
Example jgroups-relay.xml
3.2. Adding Backup Locations to Caches 复制链接链接已复制到粘贴板!
Specify the names of remote sites so Data Grid can back up data to those locations.
Procedure
-
Add the
backupselement to your cache definition. Specify the name of each remote site with the
backupelement.As an example, in the LON configuration, specify NYC as the remote site.
- Repeat the preceding steps so that each site is a backup for all other sites. For example, you cannot add LON as a backup for NYC without adding NYC as a backup for LON.
Cache configurations can be different across sites and use different backup strategies. Data Grid replicates data based on cache names.
Example "customers" configuration in LON
<replicated-cache name="customers">
<backups>
<backup site="NYC" strategy="ASYNC" />
</backups>
</replicated-cache>
<replicated-cache name="customers">
<backups>
<backup site="NYC" strategy="ASYNC" />
</backups>
</replicated-cache>
Example "customers" configuration in NYC
<distributed-cache name="customers">
<backups>
<backup site="LON" strategy="SYNC" />
</backups>
</replicated-cache>
<distributed-cache name="customers">
<backups>
<backup site="LON" strategy="SYNC" />
</backups>
</replicated-cache>
Reference
3.3. Backing Up to Caches with Different Names 复制链接链接已复制到粘贴板!
By default, Data Grid replicates data between caches that have the same name.
Procedure
-
Use
backup-forto replicate data from a remote site into a cache with a different name on the local site.
For example, the following configuration backs up the "customers" cache on LON to the "eu-customers" cache on NYC.
3.4. Verifying Cross-Site Views 复制链接链接已复制到粘贴板!
After you configure Data Grid for cross-site replication, you should verify that Data Grid clusters successfully form cross-site views.
Procedure
-
Check log messages for
ISPN000439: Received new x-site viewmessages.
For example, if the Data Grid cluster in LON has formed a cross-site view with the Data Grid cluster in NYC, it provides the following messages:
INFO [org.infinispan.XSITE] (jgroups-5,${server.hostname}) ISPN000439: Received new x-site view: [NYC]
INFO [org.infinispan.XSITE] (jgroups-7,${server.hostname}) ISPN000439: Received new x-site view: [NYC, LON]
INFO [org.infinispan.XSITE] (jgroups-5,${server.hostname}) ISPN000439: Received new x-site view: [NYC]
INFO [org.infinispan.XSITE] (jgroups-7,${server.hostname}) ISPN000439: Received new x-site view: [NYC, LON]
Configure Hot Rod clients to use Data Grid clusters at different sites.
hotrod-client.properties
# Servers at the active site infinispan.client.hotrod.server_list = LON_host1:11222,LON_host2:11222,LON_host3:11222 # Servers at the backup site infinispan.client.hotrod.cluster.NYC = NYC_hostA:11222,NYC_hostB:11222,NYC_hostC:11222,NYC_hostD:11222
# Servers at the active site
infinispan.client.hotrod.server_list = LON_host1:11222,LON_host2:11222,LON_host3:11222
# Servers at the backup site
infinispan.client.hotrod.cluster.NYC = NYC_hostA:11222,NYC_hostB:11222,NYC_hostC:11222,NYC_hostD:11222
ConfigurationBuilder
ConfigurationBuilder builder = new ConfigurationBuilder();
builder.addServers("LON_host1:11222;LON_host2:11222;LON_host3:11222")
.addCluster("NYC")
.addClusterNodes("NYC_hostA:11222;NYC_hostB:11222;NYC_hostC:11222;NYC_hostD:11222")
ConfigurationBuilder builder = new ConfigurationBuilder();
builder.addServers("LON_host1:11222;LON_host2:11222;LON_host3:11222")
.addCluster("NYC")
.addClusterNodes("NYC_hostA:11222;NYC_hostB:11222;NYC_hostC:11222;NYC_hostD:11222")
Use the following methods to switch Hot Rod clients to the default cluster or to a cluster at a different site:
-
RemoteCacheManager.switchToDefaultCluster() -
RemoteCacheManager.switchToCluster(${site.name})
Chapter 4. Performing Cross-Site Replication Operations 复制链接链接已复制到粘贴板!
Bring sites online and offline. Transfer cache state to remote sites.
4.1. Cross-Site Operations with the CLI 复制链接链接已复制到粘贴板!
The Data Grid command line interface lets you remotely connect to Data Grid servers, manage sites, and push state transfer to backup locations.
Prerequisites
- Start the Data Grid CLI.
- Connect to a running Data Grid cluster.
4.1.1. Bringing Backup Locations Offline and Online 复制链接链接已复制到粘贴板!
Take backup locations offline manually and bring them back online.
Procedure
Check if backup locations are online or offline with the
site statuscommand://containers/default]> site status --cache=cacheName --site=NYC
//containers/default]> site status --cache=cacheName --site=NYCCopy to Clipboard Copied! Toggle word wrap Toggle overflow Note--siteis an optional argument. If not set, the CLI returns all backup locations.Bring backup locations online with the
bring-onlinecommand://containers/default]> site bring-online --cache=customers --site=NYC
//containers/default]> site bring-online --cache=customers --site=NYCCopy to Clipboard Copied! Toggle word wrap Toggle overflow Take backup locations offline with the
take-offlinecommand://containers/default]> site take-offline --cache=customers --site=NYC
//containers/default]> site take-offline --cache=customers --site=NYCCopy to Clipboard Copied! Toggle word wrap Toggle overflow
For more information and examples, run the help site command.
4.1.2. Pushing State to Backup Locations 复制链接链接已复制到粘贴板!
Transfer cache state to remote backup locations.
Procedure
Use the
sitecommand to push state transfer, as in the following example://containers/default]> site push-site-state --cache=cacheName --site=NYC
//containers/default]> site push-site-state --cache=cacheName --site=NYCCopy to Clipboard Copied! Toggle word wrap Toggle overflow
For more information and examples, run the help site command.
Reference
4.2. Cross-Site Operations with the REST API 复制链接链接已复制到粘贴板!
Data Grid servers provide a REST API that allows you to perform cross-site operations.
4.2.1. Getting Status of All Backup Locations 复制链接链接已复制到粘贴板!
Retrieve the status of all backup locations with GET requests.
GET /v2/caches/{cacheName}/x-site/backups/
GET /v2/caches/{cacheName}/x-site/backups/
Data Grid responds with the status of each backup location in JSON format, as in the following example:
{
"NYC": "online",
"LON": "offline"
}
{
"NYC": "online",
"LON": "offline"
}
| Value | Description |
|---|---|
|
| All nodes in the local cluster have a cross-site view with the backup location. |
|
| No nodes in the local cluster have a cross-site view with the backup location. |
|
| Some nodes in the local cluster have a cross-site view with the backup location, other nodes in the local cluster do not have a cross-site view. The response indicates status for each node. |
4.2.2. Getting Status of Specific Backup Locations 复制链接链接已复制到粘贴板!
Retrieve the status of a backup location with GET requests.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}
GET /v2/caches/{cacheName}/x-site/backups/{siteName}
Data Grid responds with the status of each node in the site in JSON format, as in the following example:
{
"NodeA":"offline",
"NodeB":"online"
}
{
"NodeA":"offline",
"NodeB":"online"
}
| Value | Description |
|---|---|
|
| The node is online. |
|
| The node is offline. |
|
| Not possible to retrieve status. The remote cache could be shutting down or a network error occurred during the request. |
4.2.3. Taking Backup Locations Offline 复制链接链接已复制到粘贴板!
Take backup locations offline with GET requests and the ?action=take-offline parameter.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=take-offline
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=take-offline
4.2.4. Bringing Backup Locations Online 复制链接链接已复制到粘贴板!
Bring backup locations online with the ?action=bring-online parameter.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=bring-online
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=bring-online
4.2.5. Pushing State to Backup Locations 复制链接链接已复制到粘贴板!
Push cache state to a backup location with the ?action=start-push-state parameter.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=start-push-state
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=start-push-state
4.2.6. Canceling State Transfer 复制链接链接已复制到粘贴板!
Cancel state transfer operations with the ?action=cancel-push-state parameter.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=cancel-push-state
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=cancel-push-state
4.2.7. Getting State Transfer Status 复制链接链接已复制到粘贴板!
Retrieve status of state transfer operations with the ?action=push-state-status parameter.
GET /v2/caches/{cacheName}/x-site/backups?action=push-state-status
GET /v2/caches/{cacheName}/x-site/backups?action=push-state-status
Data Grid responds with the status of state transfer for each backup location in JSON format, as in the following example:
{
"NYC":"CANCELED",
"LON":"OK"
}
{
"NYC":"CANCELED",
"LON":"OK"
}
| Value | Description |
|---|---|
|
| State transfer to the backup location is in progress. |
|
| State transfer completed successfully. |
|
| An error occurred with state transfer. Check log files. |
|
| State transfer cancellation is in progress. |
4.2.8. Clearing State Transfer Status 复制链接链接已复制到粘贴板!
Clear state transfer status for sending sites with the ?action=clear-push-state-status parameter.
GET /v2/caches/{cacheName}/x-site/local?action=clear-push-state-status
GET /v2/caches/{cacheName}/x-site/local?action=clear-push-state-status
4.2.9. Modifying Take Offline Conditions 复制链接链接已复制到粘贴板!
Sites go offline if certain conditions are met. Modify the take offline parameters to control when backup locations automatically go offline.
Procedure
Check configured take offline parameters with
GETrequests and thetake-offline-configparameter.GET /v2/caches/{cacheName}/x-site/backups/{siteName}/take-offline-configGET /v2/caches/{cacheName}/x-site/backups/{siteName}/take-offline-configCopy to Clipboard Copied! Toggle word wrap Toggle overflow The Data Grid response includes
after_failuresandmin_waitfields as follows:{ "after_failures": 2, "min_wait": 1000 }{ "after_failures": 2, "min_wait": 1000 }Copy to Clipboard Copied! Toggle word wrap Toggle overflow Modify take offline parameters in the body of
PUTrequests.PUT /v2/caches/{cacheName}/x-site/backups/{siteName}/take-offline-configPUT /v2/caches/{cacheName}/x-site/backups/{siteName}/take-offline-configCopy to Clipboard Copied! Toggle word wrap Toggle overflow
4.2.10. Canceling State Transfer from Receiving Sites 复制链接链接已复制到粘贴板!
If the connection between two backup locations breaks, you can cancel state transfer on the site that is receiving the push.
Cancel state transfer from a remote site and keep the current state of the local cache with the ?action=cancel-receive-state parameter.
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=cancel-receive-state
GET /v2/caches/{cacheName}/x-site/backups/{siteName}?action=cancel-receive-state
4.2.11. Getting Status of Backup Locations 复制链接链接已复制到粘贴板!
Retrieve the status of all backup locations from Cache Managers with GET requests.
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/
Data Grid responds with status in JSON format, as in the following example:
| Value | Description |
|---|---|
|
| All nodes in the local cluster have a cross-site view with the backup location. |
|
| No nodes in the local cluster have a cross-site view with the backup location. |
|
| Some nodes in the local cluster have a cross-site view with the backup location, other nodes in the local cluster do not have a cross-site view. The response indicates status for each node. |
4.2.12. Taking Backup Locations Offline 复制链接链接已复制到粘贴板!
Take backup locations offline with the ?action=take-offline parameter.
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=take-offline
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=take-offline
4.2.13. Bringing Backup Locations Online 复制链接链接已复制到粘贴板!
Bring backup locations online with the ?action=bring-online parameter.
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=bring-online
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=bring-online
4.2.14. Starting State Transfer 复制链接链接已复制到粘贴板!
Push state of all caches to remote sites with the ?action=start-push-state parameter.
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=start-push-state
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=start-push-state
4.2.15. Canceling State Transfer 复制链接链接已复制到粘贴板!
Cancel ongoing state transfer operations with the ?action=cancel-push-state parameter.
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=cancel-push-state
GET /rest/v2/cache-managers/{cacheManagerName}/x-site/backups/{siteName}?action=cancel-push-state