CN102902730A - Method and device for reading data based on data cache - Google Patents
Method and device for reading data based on data cache Download PDFInfo
- Publication number
- CN102902730A CN102902730A CN2012103333708A CN201210333370A CN102902730A CN 102902730 A CN102902730 A CN 102902730A CN 2012103333708 A CN2012103333708 A CN 2012103333708A CN 201210333370 A CN201210333370 A CN 201210333370A CN 102902730 A CN102902730 A CN 102902730A
- Authority
- CN
- China
- Prior art keywords
- data
- value
- keyword
- storehouse
- key assignments
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a method and a device for reading data based on data cache. The method comprises the steps of: receiving read access request information (of a user) for obtaining data input, and extracting a generated key word; determining a data key value corresponding to a key word which is not subjected to cache generation in a cache databank, and initializing a mark value of data to be obtained; or determining a data key value corresponding to a key word which is subjected to cache generation in the cache databank, wherein the data included in the cached data key value is invalid, and setting the mark value of the data to be obtained as the mark value included in the obtained data key value; reading and checking a sub-bank of the databank so as to obtain data corresponding to the generated key word; obtaining time stamp information of the sub-bank of the databank, setting data key value information of key value pairs according to the set mark of the data to be obtained, the read time stamp information of the sub-bank of the databank and the data to be obtained, and updating the cache databank; and outputting the data obtained through checking. With the adoption of the method and the device, the cache efficiency of the data is improved, and the comprehensive property in data cache is optimized.
Description
Technical field
The present invention relates to the cache database technology, relate in particular to a kind of data reading method of based on data buffer memory.
Background technology
In current information society, database technology and software have been widely applied to each business unit.For example, banking system, tax system, ticket sale system, financial system, personnel system etc., in the web epoch, vast as the open sea technical information such as user profile, merchandise news, social information of management, the cache database technology is present unique feasible scheme.
Yet, when the data volume in the database that comprises technical information is calculated take T, P as unit, disk I/O, i.e. application access physical data source becomes database access efficient insurmountable barrier.On the one hand, need the usage data storehouse to store the technical information of big data quantity; On the other hand, the disk I/O performance constraint of poor efficiency the efficient operation of database.
In order to improve the operational efficiency of database, prior art has proposed Data cache technology.Data cached between application program and physical data source, its effect is the frequency of the physical data source being accessed in order to reduce application program, because the medium of buffer memory generally is internal memory, thereby its read or write speed is very fast, thereby improves the runnability of using.
Use buffer memory to bring inevitably two technical matterss, the one, the data in the buffer memory and the consistance of physical data; The 2nd, data cached ageing (term of validity).Particularly large database generally adopts trunking mode storage data at present, and adopt database master library and database from the storehouse, the data write operation is separated with data reading operation, so that data cached and physical data is mutual, compare alternately with data in magnetic disk with the internal memory on the separate unit main frame, more complex and various, data synchronism and ageing problem also become more outstanding.
At present, have much based on the right cache database technology of key assignments (key-value), for example, distributed cache system (Memcached), key-value storage system (Redis, Remote Dictionary Server) etc., realized data cached efficient access, yet, ageing and consistance for data cached all depends on the strategy that the database network operator pre-establishes.Traditional strategy is in new database master library more, makes the data ineffective treatment of buffer memory in the cache database; Write cache database then from database from the storehouse reading out data, and with the data that read, for example, in Memcached, upgrade data cached; Upgrade data cached in, according to server (Memcached) load, fixingly set data cached effective time, such as 24 hours etc.
Yet, in case the database read write access is frequent, because can not carrying out real-time synchronization from the storehouse, database master library and database upgrade, inconsistent phenomenon can often occur from the storehouse will to cause database master library and database, and the inconsistent time can not survey owing to highly depend on server load (the data cached effective time of setting), so that the inconsistent phenomenon of physical data often occurs in data cached and the database; Further, in the data cached term of validity, perhaps inconsistent data in the database master library are carried out before the write access, the data that write in the data that the user obtains by caching mechanism access cache database and the database master library are inconsistent next time, and consistance is relatively poor; And if with data cached out-of-service time set shorter, although can improve data consistency, because data frequent failure in the cache database, thereby bring cache hit rate to reduce, affect the efficient of buffer memory.Thereby, how between data consistency, ageing and buffer memory high-level efficiency, obtain preferably balance, be a problem demanding prompt solution.
Summary of the invention
Embodiments of the invention provide a kind of data reading method of based on data buffer memory, promote the buffer efficiency of data, the combination property of optimization data buffer memory.
Embodiments of the invention also provide a kind of read data device of based on data buffer memory, promote the buffer efficiency of data, the combination property of optimization data buffer memory.
For achieving the above object, the data reading method of a kind of based on data buffer memory that the embodiment of the invention provides comprises:
Receive the read access request information that the user is used for obtaining the data input, extract read access request information, generate keyword;
The query caching database is determined in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained;
Data corresponding to keyword that obtain generating are inquired about from the storehouse in the read data storehouse;
Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information of key-value pair is set, and upgrades cache database;
The data that inquiry obtains are exported.
Wherein, before described reception user is used for obtaining the read access request information of data input, further comprise:
Obtain the data message that the user writes, extract the data message that the user writes, generate corresponding keyword;
The query caching database is searched data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and the write into Databasce master library.
Wherein, in the cache database, with keyword-data key assignments storage data, described data key assignments comprises: timestamp, sign and data.
Wherein, the value of statistical indicant of described initialization data to be obtained comprises:
The value of statistical indicant of setting data to be obtained is 0.
Wherein, the data failure that comprises in the data key assignments of described buffer memory comprises:
Resolve the data key assignments that inquiry obtains, the timestamp information that comprises in the acquisition data key assignments, the current time stamp when judging parsing and the timestamp of acquisition are if the current time stamp is determined the data failure that comprises in this data key assignments greater than the timestamp of acquisition.
Wherein, further comprise:
If current time stamp is less than or equal to the timestamp of acquisition, the data that comprise in the data key assignments that inquiry is obtained are exported as data to be obtained.
Wherein, the sign of described data to be obtained according to arranging, read data storehouse are from timestamp information and the data to be obtained in storehouse, and the data key value information that key-value pair is set comprises:
With data to be obtained as the data in the data key value information;
The sign of the data to be obtained that arrange is added 1, as the sign in the data key value information;
From the timestamp information in storehouse and the timestamp value computing formula that sets in advance, calculate the data cached effective time of upgrading, as the timestamp in the data key value information according to the sign in the data key value information, read data storehouse.
Wherein, described timestamp value computing formula is:
time=time2+αxη
flag′
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1；
Flag is the sign of data to be obtained.
Wherein, described in cache database after this data deletion of buffer memory, or, behind the write into Databasce master library, further comprise: return to the user and write successful information.
Wherein, further comprise:
If, there are not the data corresponding with the keyword that generates from the storehouse in Query Database, return the read data failure information to the user.
A kind of read data device of based on data buffer memory, this device comprises: read data module, data cached library module and database be from library module, wherein,
The read data module is used for receiving the read access request information that the user is used for obtaining the data input, extracts read access request information, generates keyword;
Data cached library module is used for inquiring about according to the keyword that the read data module generates, and determines in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained;
Database is used for the read data storehouse from the storehouse from library module, and data corresponding to keyword that inquiry obtains generating are exported the data that inquiry obtains;
Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information of key-value pair is set, and upgrades cache database.
Described data cached library module comprises: query unit, judging unit, initialization unit and data key assignments processing unit, wherein,
Query unit is used for inquiring about according to the keyword that the read data module generates;
Judging unit judges whether query unit inquires the data key assignments corresponding to keyword of generation, and if so, the data key assignments that inquiry is obtained exports data key assignments processing unit to; Otherwise, to initialization unit output trigger message;
Initialization unit is used for according to the trigger message that receives, and the value of statistical indicant of initialization data to be obtained is exported from library module to database;
Data key assignments processing unit, be used for resolving the data key assignments that inquiry obtains, the timestamp information that comprises in the acquisition data key assignments, judge current time stamp and the timestamp that obtains when resolving, if current time stamp is less than or equal to the timestamp of acquisition, the data that comprise in the data key assignments that inquiry is obtained are exported as data to be obtained; If the current time stamp, is set the value of statistical indicant of value of statistical indicant for comprising in the data key assignments that obtains of data to be obtained greater than the timestamp that obtains, export from library module to database.
Further comprise: write data module and database master library module, wherein,
Write data module, obtain the data message that the user writes, extract the data message that the user writes, generate corresponding keyword;
Data cached library module is further used for inquiring about according to the keyword of writing the data module generation, searches data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module;
Database master library module is used for receiving the keyword that data cached library module writes-data key-value pair, stores.
Described data cached library module further comprises:
Write data processing unit, whether be used for judging query unit according to the data key assignments of the keyword query of writing the data module generation to correspondence, if so, with this data deletion of buffer memory; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module.
The sign of described data to be obtained according to arranging, read data storehouse are from timestamp information and the data to be obtained in storehouse, and the data key value information that key-value pair is set comprises:
With data to be obtained as the data in the data key value information;
The sign of the data to be obtained that arrange is added 1, as the sign in the data key value information;
From the timestamp information in storehouse and the timestamp value computing formula that sets in advance, calculate the data cached effective time of upgrading, as the timestamp in the data key value information according to the sign in the data key value information, read data storehouse.
Described timestamp value computing formula is:
time=time2+αxη
flag′
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1；
Flag is the sign of data to be obtained.
As seen from the above technical solution, data reading method and the device of a kind of based on data buffer memory that the embodiment of the invention provides receive the read access request information that the user is used for obtaining the data input, extract read access request information, generate keyword; The query caching database is determined in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained; Data corresponding to keyword that obtain generating are inquired about from the storehouse in the read data storehouse; Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information of key-value pair is set, and upgrades cache database; The data that inquiry obtains are exported.Like this, by being data setup times stamp and the sign of buffer memory in the cache database, behind the data failure that in the data key assignments of buffer memory, comprises, the sign that comprises in the data key assignments is upgraded, and the timestamp that comprises in the corresponding renewal data key assignments, avoided frequently cache database being upgraded, promote the buffer efficiency of data, make between data consistency, the ageing and buffer memory high-level efficiency and obtain preferably balance, optimized the combination property of data buffer storage.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art.Apparently, the accompanying drawing in below describing only is some embodiments of the present invention, for those of ordinary skills, can also obtain according to these accompanying drawing illustrated embodiments other embodiment and accompanying drawing thereof.
Fig. 1 is the data reading method schematic flow sheet of embodiment of the invention based on data buffer memory.
Fig. 2 is the data reading method idiographic flow synoptic diagram of embodiment of the invention based on data buffer memory.
Fig. 3 is the data writing method idiographic flow synoptic diagram of embodiment of the invention based on data buffer memory.
Fig. 4 is the read data apparatus structure synoptic diagram of embodiment of the invention based on data buffer memory.
Embodiment
Below with reference to accompanying drawing the technical scheme of various embodiments of the present invention is carried out clear, complete description, obviously, described embodiment only is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are resulting all other embodiment under the prerequisite of not making creative work, all belong to the scope that the present invention protects.
The data reading method of existing based on data buffer memory, keyword according to user's input, the query caching database, if the data key assignments that this keyword is not corresponding in the cache database, then read data corresponding to this keyword from the storehouse from database, and the data that read are write cache database, for example, in Memcached, upgrade data cached, when renewal is data cached, according to server (Memcached) load, fixes and set data cached effective time, such as 24 hours, with as the follow-up term of validity that from cache database, reads these data of user.But this is fixedly installed the mode of data cached effective time, and is longer if data cached effective time value arranges, and causes easily the data's consistency that writes in data that the user obtains by the caching mechanism access and the database master library relatively poor; And if will be data cached that effective time, value was set is shorter, although can improve the data's consistency that writes in data that the user obtains by caching mechanism access and the database master library, but because data need frequent updating in the cache database, according to the keyword query cache database, thereby bring cache hit rate to reduce, after inquiring about unsuccessfully, need again from database reading out data from the storehouse, and the data that read are write in the cache database, affect the performance of buffer memory, also reduced the efficient of read data.
In the embodiment of the invention, provide the technology of read data in a kind of cache database, by increasing a single timestamp, can effectively solve data age and conforming problem in the existing caching technology.Specifically, setup times stamp (time) information and sign (flag) information in the data of data cached banked cache are by obtaining read access request information; Extract read access request information, form keyword (key); According to the keyword query cache database, if there be data key assignments (value) corresponding to this keyword, then judge according to key assignments whether data corresponding to this keyword lost efficacy, if do not lose efficacy, then the data that this keyword is corresponding are exported to the user; If the data that this keyword is corresponding had lost efficacy or, there be not data key assignments corresponding to this keyword in the cache database, then from the storehouse, read data corresponding to this keyword from database, and data key assignments corresponding to this keyword be set, namely generate key-value pair, upgrade cache database according to the data key-value pair that arranges.Like this, can take into full account the high efficiency of data age and cache access, obtain preferably balance in data consistency, ageing and access between the high efficiency.
Below with Memcached as cache database, read-write process of the present invention is described.Memcached is a high performance distributed memory target cache system, is used for Dynamic Web Applications to alleviate database loads.Reduce the number of times of reading database by data cached in internal memory and object, thereby speed dynamic, the database-driven website is provided.
The embodiment of the invention that it should be noted that not only only is applied to Memcached can also be applied to adopt other caching technology as the situation of cache database as cache database, for example, and Redis etc.
Fig. 1 is the data reading method schematic flow sheet of embodiment of the invention based on data buffer memory.Referring to Fig. 1, this flow process comprises:
Preferably, in the embodiment of the invention, before step 01, can further include:
A01 obtains the data message that the user writes, and extracts the data message that the user writes, and generates corresponding keyword;
A02, the query caching database is searched data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and the write into Databasce master library.
In the practical application, after these data of buffer memory are deleted in cache database, and behind the write into Databasce master library, can also further return to the user and write successful information.
The below is described in further detail the embodiment of the invention based on Fig. 1.
Fig. 2 is the data reading method idiographic flow synoptic diagram of embodiment of the invention based on data buffer memory.The embodiment of the invention provides the method for user by the caching mechanism reading database, and referring to Fig. 2, this flow process comprises:
Step 11 receives the read access request information that the user is used for obtaining the data input;
In this step, when the user need to obtain data, namely from database during data query, namely from cache database or database from the storehouse, read corresponding data, the query statement of input inquiry data, be read access request information, for example, if the user needs search database to obtain certain technical information, for instance, the data relevant with technologyinformation need to be from database, read out, then read access request information: technologyinformation can be in the read data window interface of database, inputted.
In the embodiment of the invention, establishing the data that will obtain is variable data.
In this step, according to the read access request information of user input: technology information, carry out extraction operation, generating keyword (key) is tech_info.For example, can generate software according to the keyword that sets in advance, the information of user's input is processed, generate keyword, about extracting read access request information, generate the flow process of keyword, specifically can referring to the correlation technique document, not repeat them here.
In this step, when needs are inquired about data to be obtained, at first from cache database, inquire about, if store data key assignments corresponding to keyword in the cache database, then extract the data that comprise in the data key assignments, directly return the data that inquiry obtains to the user, then can avoid from the storehouse, inquiring about data to be obtained from database, thus the speed of Effective Raise read data and efficient.
In the embodiment of the invention, search in cache database whether to have key be the data key assignments of tach_info, if there is this data key assignments, execution in step 14, if there is no this data key assignments, the value of statistical indicant of initialization data to be obtained, for example, the value of statistical indicant (flag) of setting data to be obtained is 0 for a certain constant that sets in advance, execution in step 15.
In the embodiment of the invention, in the cache database, with keyword-data key assignments storage data, wherein, keyword can according to the demand in the practical application, utilize the keyword extraction technology, a large amount of query statements extracted obtain, certainly, in the practical application, also can be set according to user's request by the database maintenance person; Data key assignments (value) comprises: timestamp (time), sign (flag) and data (data), namely in the data of storage, carry key word information, timestamp information and flag information, from existing adopt keyword-data key assignments storage data different be, in the embodiment of the invention, its timestamp value capable of dynamic is adjusted, in addition, also increased the calculated factor that is used for as dynamically adjusting data cached effective time, i.e. sign, wherein
Timestamp is used for identifying data cached effective time;
Sign is used for as the calculated factor of dynamically adjusting data cached effective time.
In this step, resolve the data key assignments that inquiry obtains, obtain timestamp (time0), sign (flag0) and data (data0), establish the current time stamp and be time1, the timestamp and the current time stamp that obtain are compared, namely compare the size of time1 and time0:
If time1 is less than or equal to time0, namely be less than or equal to data cached effective time, the data data0 of current cache in the cache database be described before the deadline, with the data0 assignment to data, be about to the data of this buffer memory as data to be obtained, execution in step 17; If time1 is greater than time0, namely greater than data cached effective time, the data data0 that current cache in the cache database is described has exceeded the term of validity, data are invalid, thereby these data that inquiry obtains can not as data to be obtained, be set the value of statistical indicant of value of statistical indicant for comprising in the data key assignments that obtains of data to be obtained, the value of statistical indicant flag that is about to data to be obtained is set as flag0, execution in step 15;
In this step, from the storehouse, inquire about whether there is the keyword that is complementary with the keyword that generates from database, if there is the keyword that is complementary, obtain the data data1 corresponding to keyword of this coupling, with the data1 assignment to data; If there is no, then finish the read data flow process, return the read data failure information to the user.
In the embodiment of the invention, database data layout of buffer memory from the storehouse is same as the prior art, adopts keyword-data as storage format.
In this step, by setting the right value information of buffer memory key-value, with key-value to storing in the cache database, thereby realize renewal to this data buffer storage data effective time in the cache database.
If the read data storehouse is time2 from the timestamp in storehouse, wherein, the timestamp value computing formula of setting among the value is:
time=time2+αxη
flag′
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1
Flag is the sign of data to be obtained.
Wherein,
Ax η
Flag 'Also become interval effective time, when arranging, main consider to change the fast data of frequency for read-write, its, interval was shorter effective time; Change the slow data of frequency for read-write, its, interval was longer effective time.In the embodiment of the invention, the amount of control interval length effective time is the value of sign flag, if data often are in disarmed state in the buffer memory, it is very fast to show that read-write changes frequency, value by sign flag corresponding to these data is set to 0, thus can so that its effective time the interval longer.
Data base effective time, the person sets according to actual conditions by cache management, can be the experience time, for example, 10s, 30s etc., as long as satisfy for the more data of access times in the unit interval, its corresponding data base is less effective time, and for the less data of access times in the unit interval, its corresponding data base gets final product more greatly effective time, certainly, and in the practical application, also can according to the data access frequency of dynamic statistics, adjust corresponding data base effective time in good time;
The benchmark expanding value is the multiple at each setting data benchmark interval effective time, can be set according to practical situations by the cache management person, on the occasion of, generally greater than 1, for example, be taken as 2 or other constant values;
In the embodiment of the invention, after the data cached inefficacy of at every turn from cache database, reading, the value of statistical indicant flag of data to be obtained is set as flag0, when the right data key value information of key-value is set, upgrade the value of statistical indicant flag of data to be obtained, be about to the flag0 execution and add the 1 value of statistical indicant flag as the data to be obtained of upgrading.
In the practical application, the timestamp value formula of setting also can adopt other formula, for example, changes the exponential quantity in the following formula, time=time2+ α x η
1+flag 'Again for example, can also be set to: time=time2+ α x η xflag ' etc.
Like this, the value of the data of buffer memory is spliced by timestamp time, sign flag and data data, the keyword of key assignments for generating.
For instance, suppose to have a customer information database, comprise cache database, database master library and database from the storehouse, the user need to search the information of client angle by name, suppose that customer information database use Memcached does the data buffer storage storehouse, the keyword key that user name angle is corresponding is customer name self, i.e. angle, the user inputs read access request information: angle, and customer information database is searched first data key assignments corresponding to keyword angle in cache database.
If having key in cache database is the data key assignments of angle, resolve, its value is 2012:06:1200:00:00; 1; Tel:xxxx, wherein, timestamp time0 is that 2012:06:1200:00:00, sign flag0 are 1, data0 is tel:xxxx.
Current time stamp time1 when supposing to resolve is 2012:08:2100:00:00, then since time1 greater than time0, illustrate that data data0 has exceeded the term of validity, data are invalid, then the information that keyword is angle is searched from the storehouse in the read data storehouse, and obtaining data data corresponding to angle is tel:aaxx, data is returned to the user, and reset the data cached of Memcached.
Obtain the read data storehouse from timestamp (also can be the data cached timestamp of the reseting Memcached) time2 in storehouse, for example, time2 is 2012:08:2100:01:00.Current time stamp during owing to the data cached timestamp of reseting Memcached and parsing (also can be accessing database obtains data from the storehouse timestamp) is inconsistent, thereby time2 is different from time1.Set data to be obtained (data cached key assignments to be updated) flag=flag0+1=2, be 30s the benchmark effective time of fetching data, and then can calculate the data cached term of validity among the Memcached (data cached effective time) and be:
time=time2+αxη
flag'=2012：08：2100：03：00
So, can set key is that the value that the data of angle are preserved in Memcached is 2012:08:2100:03:00; 2; Tel:aaxx.
If the current time when resolving, stamp time1 was 2012:06:1100:00:00, because time1 is less than time0, data are still effective among the Memcached, at this moment, are tel:xxxx with the data assignment directly, and return to the user and get final product.
Fig. 3 is the data writing method idiographic flow synoptic diagram of embodiment of the invention based on data buffer memory.Present embodiment provides the user to write the method for database by caching mechanism, when writing the database master library, upgrades the data among the buffer memory Memcached, and referring to Fig. 3, this flow process comprises:
In this step, can be at the input data information in the data window interface of writing of database.
In this step, if the user need to be toward data writing in the database, for example, need to write certain technical information technology information, then can input technologyin formation and particular content thereof, database extracts the data message that the user writes, and the generation keyword is tech_info, and setting the right key of buffer memory key-value is tech_info.
In the embodiment of the invention, the key value is that the keyword according to the user accesses data storehouse obtains, and for example, needs major key during data among the access Mysql, can set key among the Memcached according to major key.And how to set key, and can be made by oneself by the Memcached keeper, can be with major key as key, also can be with major key and other information as key.The present invention does setting to the value value, and is irrelevant with key.
Step 25, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and the write into Databasce master library;
By as seen above-mentioned, the method for reading and writing data of embodiment of the invention based on data buffer memory, on the basis of raw data, by extra increase timestamp and sign flag, timestamp is used for the term of validity of flag data, be data cached effective time, sign is used for calculating effective time, namely as the calculated factor of dynamically adjusting data cached effective time; And set more the timestamp of new data be the current time and effective time the interval sum, wherein, effective time, the interval was with data base effective time, benchmark expanding value and indicate relevant, when setting effective time interval, utilized following thought: read-write changes the fast data of frequency, and its, interval was shorter effective time; Read-write changes the slow data of frequency, and its, interval was longer effective time, and the amount of control interval length effective time is the value of sign flag.Like this, change the fast data of frequency for read-write, renewal frequency is very fast, change the slow data of frequency for read-write, renewal frequency is slow, thereby is guaranteeing on the conforming basis of reading and writing data, has reduced because the cache hit rate that the data frequent failure causes in the cache database reduces, affect the problem of the efficient of buffer memory, reached preferably the balance between the high efficiency of data consistency and access cache.
For instance, if key0 and corresponding value value0 thereof are arranged, if to key0, do not carry out for a long time read operation, namely do not change the value of key0, along with the increase of time, flag value corresponding among its value0 can increase gradually along with the inefficacy of value0, the every inefficacy of value0 once, flag increases by 1, namely effective time, the interval became the multiple of previous benchmark expanding value.In the embodiment of the invention, because effective time, the interval was exponential increase, thereby, only need the seldom reading database of number of times, what can will become effective time is very long.If the schedule time is t, the Failure count of value then, namely within the predetermined time, need to data cached carry out read access take the number of times that upgrades as:
Log (t/ data base effective time)/log (benchmark expanding value).
Thereby, compare with traditional strategy, need to carry out read access and will lack with the number of times that upgrades data cached, few number of times is:
Log (t/ data base effective time)/log (benchmark expanding value)-1.
If the data write operation that key0 is corresponding is frequent, then its, interval was about data base effective time effective time, compared with traditional strategy, set effective time hour when benchmark, and the inconsistent duration of data is also very little.
In the embodiment of the invention, behind each data failure, if these data are still arranged among the Memcached, then flag is not set as 0.Only when writing the database master library, with the data deletion or when the Memcached Automatic clearance stale data, after the data deletion, when not existing key word to be the data key assignments of key among the Memcached, flag is set as 0, if there is not this data item, flag is set as 0.
Lift again an object lesson, if being used for the time of statistics is 1 hour, set in the conventional measures and be respectively 100s and 10s effective time, wherein, the out-of-service time is equivalent to the data base effective time of the embodiment of the invention, correspondingly, if data base also is respectively 100s and 10s effective time in this strategy, the benchmark expanding value is 2, and then in 1 hour, the Data Comparison of conventional measures and strategy of the present invention respectively as shown in Table 1 and Table 2.Wherein, be 100s the effective time that table 1 is set, and be 10s the effective time that table 2 is set.
Table 1
| Conventional measures | Strategy of the present invention | |
| To the database update times | 36 | 6 |
| The inconsistent time upper limit of data | 100 | 1600 |
| The inconsistent time lower limit of data | 100 | 100 |
| Data inconsistent averaging times | 100 |
Table 2
| Conventional measures | Strategy of the present invention | |
| To the database update times | 360 | 11 |
| The inconsistent time upper limit of data (s) | 10 | 1052 |
| The inconsistent time lower limits of data (s) | 10 | 10 |
| Data inconsistent averaging time (s) | 10 | 327 |
By table 1 and as seen from Table 2, for being effective time the situation of 100s, in 1 hour, conventional measures need to be carried out 36 times to database and upgraded, and strategy of the present invention only needs to carry out 6 times to database and upgrades; For being effective time the situation of 10s, in 1 hour, conventional measures need to be carried out 360 renewals to database, and strategy of the present invention only needs carry out 11 renewals to database.Like this, effectively reduce the number of times of database frequent updating, thereby reduced because the problem that the cache hit rate that the data frequent failure causes in the cache database reduces is conducive to reduce the load of database place server; Simultaneously, also can guarantee preferably data's consistency, between the high efficiency of data consistency and access cache, reach preferably balance.
Fig. 4 is the read data apparatus structure synoptic diagram of embodiment of the invention based on data buffer memory.Referring to Fig. 4, this device comprises: read data module, data cached library module and database be from library module, wherein,
The read data module is used for receiving the read access request information that the user is used for obtaining the data input, extracts read access request information, generates keyword;
Data cached library module is used for inquiring about according to the keyword that the read data module generates, and determines in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained;
Database is used for the read data storehouse from the storehouse from library module, and data corresponding to keyword that inquiry obtains generating are exported the data that inquiry obtains;
Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the right data key value information of key-value is set, and upgrades cache database.
Wherein, data cached library module comprises: query unit, judging unit, initialization unit and data key assignments processing unit (not shown), wherein,
Query unit is used for inquiring about according to the keyword that the read data module generates;
Judging unit judges whether query unit inquires the data key assignments corresponding to keyword of generation, and if so, the data key assignments that inquiry is obtained exports data key assignments processing unit to; Otherwise, to initialization unit output trigger message;
Initialization unit is used for according to the trigger message that receives, and the value of statistical indicant of initialization data to be obtained is exported from library module to database;
Data key assignments processing unit, be used for resolving the data key assignments that inquiry obtains, the timestamp information that comprises in the acquisition data key assignments, judge current time stamp and the timestamp that obtains when resolving, if current time stamp is less than or equal to the timestamp of acquisition, the data that comprise in the data key assignments that inquiry is obtained are exported as data to be obtained; If the current time stamp, is set the value of statistical indicant of value of statistical indicant for comprising in the data key assignments that obtains of data to be obtained greater than the timestamp that obtains, export from library module to database.
Preferably, this device can further include: write data module and database master library module, wherein,
Write data module, obtain the data message that the user writes, extract the data message that the user writes, generate corresponding keyword;
Data cached library module is further used for inquiring about according to the keyword of writing the data module generation, searches data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module;
Database master library module is used for receiving the keyword that data cached library module writes-data key-value pair, stores.
Preferably, data cached library module further comprises:
Write data processing unit, whether be used for judging query unit according to the data key assignments of the keyword query of writing the data module generation to correspondence, if so, with this data deletion of buffer memory; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module.
Wherein,
According to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information that key-value pair is set comprises:
With data to be obtained as the data in the data key value information;
The sign of the data to be obtained that arrange is added 1, as the sign in the data key value information;
From the timestamp information in storehouse and the timestamp value computing formula that sets in advance, calculate the data cached effective time of upgrading, as the timestamp in the data key value information according to the sign in the data key value information, read data storehouse.
In the embodiment of the invention, timestamp value computing formula is:
time=time2+αxη
flag′
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1；
Flag is the sign of data to be obtained.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also comprises these changes and modification interior.
Claims (16)
1. the data reading method of a based on data buffer memory, the method comprises:
Receive the read access request information that the user is used for obtaining the data input, extract read access request information, generate keyword;
The query caching database is determined in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained;
Data corresponding to keyword that obtain generating are inquired about from the storehouse in the read data storehouse;
Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information of key-value pair is set, and upgrades cache database;
The data that inquiry obtains are exported.
2. method according to claim 1 wherein, before described reception user is used for obtaining the read access request information of data input, further comprises:
Obtain the data message that the user writes, extract the data message that the user writes, generate corresponding keyword;
The query caching database is searched data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and the write into Databasce master library.
3. method according to claim 1 and 2 wherein, in the cache database, is stored data with keyword-data key assignments, and described data key assignments comprises: timestamp, sign and data.
4. method according to claim 3, wherein, the value of statistical indicant of described initialization data to be obtained comprises:
The value of statistical indicant of setting data to be obtained is 0.
5. method according to claim 4, wherein, the data failure that comprises in the data key assignments of described buffer memory comprises:
Resolve the data key assignments that inquiry obtains, the timestamp information that comprises in the acquisition data key assignments, the current time stamp when judging parsing and the timestamp of acquisition are if the current time stamp is determined the data failure that comprises in this data key assignments greater than the timestamp of acquisition.
6. method according to claim 5 wherein, further comprises:
If current time stamp is less than or equal to the timestamp of acquisition, the data that comprise in the data key assignments that inquiry is obtained are exported as data to be obtained.
7. method according to claim 5, wherein, the sign of described data to be obtained according to arranging, read data storehouse are from timestamp information and the data to be obtained in storehouse, and the data key value information that key-value pair is set comprises:
With data to be obtained as the data in the data key value information;
The sign of the data to be obtained that arrange is added 1, as the sign in the data key value information;
From the timestamp information in storehouse and the timestamp value computing formula that sets in advance, calculate the data cached effective time of upgrading, as the timestamp in the data key value information according to the sign in the data key value information, read data storehouse.
8. method according to claim 7, wherein, described timestamp value computing formula is:
time=time2+αxη
flag′
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1；
Flag is the sign of data to be obtained.
9. method according to claim 1 and 2, wherein described in cache database after this data deletion of buffer memory, or, behind the write into Databasce master library, further comprise: return to the user and write successful information.
10. method according to claim 1 and 2 wherein, further comprises:
If, there are not the data corresponding with the keyword that generates from the storehouse in Query Database, return the read data failure information to the user.
11. the read data device of a based on data buffer memory is characterized in that, this device comprises: read data module, data cached library module and database be from library module, wherein,
The read data module is used for receiving the read access request information that the user is used for obtaining the data input, extracts read access request information, generates keyword;
Data cached library module is used for inquiring about according to the keyword that the read data module generates, and determines in the cache database data key assignments corresponding to keyword that buffer memory not generates, the value of statistical indicant of initialization data to be obtained; Perhaps, determine to be cached with in the cache database data key assignments corresponding to keyword of generation, but the data failure that comprises in the data key assignments of buffer memory is set the value of statistical indicant that comprises in the data key assignments of value of statistical indicant for acquisition of data to be obtained;
Database is used for the read data storehouse from the storehouse from library module, and data corresponding to keyword that inquiry obtains generating are exported the data that inquiry obtains;
Obtain the read data storehouse from the timestamp information in storehouse, according to the sign of the data to be obtained that arrange, read data storehouse timestamp information and the data to be obtained from the storehouse, the data key value information of key-value pair is set, and upgrades cache database.
12. device according to claim 11 is characterized in that, described data cached library module comprises: query unit, judging unit, initialization unit and data key assignments processing unit, wherein,
Query unit is used for inquiring about according to the keyword that the read data module generates;
Judging unit judges whether query unit inquires the data key assignments corresponding to keyword of generation, and if so, the data key assignments that inquiry is obtained exports data key assignments processing unit to; Otherwise, to initialization unit output trigger message;
Initialization unit is used for according to the trigger message that receives, and the value of statistical indicant of initialization data to be obtained is exported from library module to database;
Data key assignments processing unit, be used for resolving the data key assignments that inquiry obtains, the timestamp information that comprises in the acquisition data key assignments, judge current time stamp and the timestamp that obtains when resolving, if current time stamp is less than or equal to the timestamp of acquisition, the data that comprise in the data key assignments that inquiry is obtained are exported as data to be obtained; If the current time stamp, is set the value of statistical indicant of value of statistical indicant for comprising in the data key assignments that obtains of data to be obtained greater than the timestamp that obtains, export from library module to database.
13. device according to claim 12 is characterized in that, further comprises: write data module and database master library module, wherein,
Write data module, obtain the data message that the user writes, extract the data message that the user writes, generate corresponding keyword;
Data cached library module is further used for inquiring about according to the keyword of writing the data module generation, searches data key assignments corresponding to keyword that whether has generation, if there is this data key assignments, with this data deletion of buffer memory in the cache database; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module;
Database master library module is used for receiving the keyword that data cached library module writes-data key-value pair, stores.
14. device according to claim 13 is characterized in that, described data cached library module further comprises:
Write data processing unit, whether be used for judging query unit according to the data key assignments of the keyword query of writing the data module generation to correspondence, if so, with this data deletion of buffer memory; If there is no this data key assignments, the data message according to the keyword that generates and user write generates keyword-data key-value pair, and write into Databasce master library module.
15. to 14 each described devices, it is characterized in that according to claim 11 the sign of described data to be obtained according to arranging, read data storehouse are from timestamp information and the data to be obtained in storehouse, the data key value information that key-value pair is set comprises:
With data to be obtained as the data in the data key value information;
The sign of the data to be obtained that arrange is added 1, as the sign in the data key value information;
From the timestamp information in storehouse and the timestamp value computing formula that sets in advance, calculate the data cached effective time of upgrading, as the timestamp in the data key value information according to the sign in the data key value information, read data storehouse.
16. device according to claim 15 is characterized in that, described timestamp value computing formula is:
time=time2+αxη
flag
In the formula,
Time is the data cached effective time of renewal;
Time2 is that the read data storehouse is from the timestamp in storehouse;
α is data base effective time;
η is the benchmark expanding value;
Flag ' is the sign of new data more;
flag′=flag+1；
Flag is the sign of data to be obtained.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210333370.8A CN102902730B (en) | 2012-09-10 | 2012-09-10 | Based on data reading method and the device of data buffer storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210333370.8A CN102902730B (en) | 2012-09-10 | 2012-09-10 | Based on data reading method and the device of data buffer storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102902730A true CN102902730A (en) | 2013-01-30 |
| CN102902730B CN102902730B (en) | 2016-04-20 |
Family
ID=47574963
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210333370.8A Active CN102902730B (en) | 2012-09-10 | 2012-09-10 | Based on data reading method and the device of data buffer storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102902730B (en) |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103530349A (en) * | 2013-09-30 | 2014-01-22 | 乐视致新电子科技（天津）有限公司 | Method and equipment for cache updating |
| CN103702239A (en) * | 2013-12-26 | 2014-04-02 | 乐视网信息技术（北京）股份有限公司 | Network multimedia resource data processing method and device |
| CN104133880A (en) * | 2014-07-25 | 2014-11-05 | 广东睿江科技有限公司 | Method and device for setting file cache time |
| CN104156361A (en) * | 2013-05-13 | 2014-11-19 | 阿里巴巴集团控股有限公司 | Method and system for achieving data synchronization |
| CN104572973A (en) * | 2014-12-31 | 2015-04-29 | 上海格尔软件股份有限公司 | High-performance memory caching system and method |
| CN105447167A (en) * | 2015-12-04 | 2016-03-30 | 北京奇虎科技有限公司 | Processing method and apparatus for node cache data in distributed system |
| CN105630819A (en) * | 2014-11-03 | 2016-06-01 | 阿里巴巴集团控股有限公司 | Cached data refreshing method and apparatus |
| CN105653561A (en) * | 2014-12-02 | 2016-06-08 | 阿里巴巴集团控股有限公司 | Data processing method and apparatus |
| CN105677687A (en) * | 2014-11-21 | 2016-06-15 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN105721538A (en) * | 2015-12-30 | 2016-06-29 | 东莞市青麦田数码科技有限公司 | Data access method and apparatus |
| CN106126356A (en) * | 2016-06-24 | 2016-11-16 | 努比亚技术有限公司 | The realization of a kind of server buffer, generation method and system |
| CN106156061A (en) * | 2015-03-30 | 2016-11-23 | 北大方正集团有限公司 | A kind of method and device improving efficiency data query |
| CN106302829A (en) * | 2016-10-26 | 2017-01-04 | 腾讯音乐娱乐（深圳）有限公司 | A kind of information access method, device and server |
| CN106649585A (en) * | 2016-11-18 | 2017-05-10 | 福建中金在线信息科技有限公司 | Retrieval method and device |
| CN106682202A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Search cache updating method and device |
| CN106776666A (en) * | 2015-11-25 | 2017-05-31 | 北大方正集团有限公司 | Data cache method and device based on moodle websites |
| CN106777085A (en) * | 2016-12-13 | 2017-05-31 | 东软集团股份有限公司 | A kind of data processing method, device and data query system |
| CN107330119A (en) * | 2017-07-14 | 2017-11-07 | 掌阅科技股份有限公司 | Caching data processing method, electronic equipment, computer-readable storage medium |
| CN107562905A (en) * | 2017-09-08 | 2018-01-09 | 深圳市金立通信设备有限公司 | Management method, server and the computer-readable recording medium of data |
| CN107622059A (en) * | 2016-07-13 | 2018-01-23 | 天脉聚源（北京）科技有限公司 | A kind of method and system for improving database search efficiency |
| WO2018209574A1 (en) * | 2017-05-16 | 2018-11-22 | 深圳中兴力维技术有限公司 | Alarm data query method and apparatus |
| CN108874304A (en) * | 2018-03-30 | 2018-11-23 | 北京奇艺世纪科技有限公司 | A kind of regular configuration method and device of caching system |
| CN110019263A (en) * | 2017-10-18 | 2019-07-16 | 北京京东尚科信息技术有限公司 | Information storage means and device |
| CN110222015A (en) * | 2019-06-19 | 2019-09-10 | 北京泰迪熊移动科技有限公司 | A kind of reading of file data, querying method, device and readable storage medium storing program for executing |
| CN110347545A (en) * | 2019-05-21 | 2019-10-18 | 深圳壹账通智能科技有限公司 | A kind of test method and device of business platform cache policy |
| CN110471939A (en) * | 2019-07-11 | 2019-11-19 | 平安普惠企业管理有限公司 | Data access method, device, computer equipment and storage medium |
| CN111127252A (en) * | 2019-12-24 | 2020-05-08 | 华中科技大学 | Data management method of water resource management decision support system |
| CN111381917A (en) * | 2018-12-29 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Data reading and writing method and device |
| CN111737297A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Method and device for processing link aggregation call information |
| CN111858664A (en) * | 2020-06-23 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Data persistence method and system based on BMC |
| CN113139081A (en) * | 2021-04-27 | 2021-07-20 | 中山亿联智能科技有限公司 | Method for reporting and reading user online playing information with high efficiency and low delay |
| CN113691614A (en) * | 2021-08-23 | 2021-11-23 | 城云科技（中国）有限公司 | Information processing method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1493993A (en) * | 2002-10-31 | 2004-05-05 | Lg������ʽ���� | System and method for maintaining business treatment high speed slow storage consistency in mobile computing environment |
| CN1495612A (en) * | 2002-08-07 | 2004-05-12 | �Ҵ���˾ | Method for updating timing information of retaining buffer stored data object and system |
| US6792436B1 (en) * | 2000-02-11 | 2004-09-14 | Persistence Software, Inc. | Method for synchronizing multiple software caches in a memory |
| CN1602489A (en) * | 2001-10-25 | 2005-03-30 | Bea系统公司 | System and method for flushing bean cache |
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| US20110191522A1 (en) * | 2010-02-02 | 2011-08-04 | Condict Michael N | Managing Metadata and Page Replacement in a Persistent Cache in Flash Memory |
| CN102331986A (en) * | 2010-07-12 | 2012-01-25 | 阿里巴巴集团控股有限公司 | Database cache management method and database server |
-
2012
- 2012-09-10 CN CN201210333370.8A patent/CN102902730B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6792436B1 (en) * | 2000-02-11 | 2004-09-14 | Persistence Software, Inc. | Method for synchronizing multiple software caches in a memory |
| CN1602489A (en) * | 2001-10-25 | 2005-03-30 | Bea系统公司 | System and method for flushing bean cache |
| CN1495612A (en) * | 2002-08-07 | 2004-05-12 | �Ҵ���˾ | Method for updating timing information of retaining buffer stored data object and system |
| CN1493993A (en) * | 2002-10-31 | 2004-05-05 | Lg������ʽ���� | System and method for maintaining business treatment high speed slow storage consistency in mobile computing environment |
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| US20110191522A1 (en) * | 2010-02-02 | 2011-08-04 | Condict Michael N | Managing Metadata and Page Replacement in a Persistent Cache in Flash Memory |
| CN102331986A (en) * | 2010-07-12 | 2012-01-25 | 阿里巴巴集团控股有限公司 | Database cache management method and database server |
Cited By (45)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156361B (en) * | 2013-05-13 | 2017-11-17 | 阿里巴巴集团控股有限公司 | A kind of method and system for realizing data syn-chronization |
| CN104156361A (en) * | 2013-05-13 | 2014-11-19 | 阿里巴巴集团控股有限公司 | Method and system for achieving data synchronization |
| CN103530349A (en) * | 2013-09-30 | 2014-01-22 | 乐视致新电子科技（天津）有限公司 | Method and equipment for cache updating |
| CN103702239A (en) * | 2013-12-26 | 2014-04-02 | 乐视网信息技术（北京）股份有限公司 | Network multimedia resource data processing method and device |
| CN104133880A (en) * | 2014-07-25 | 2014-11-05 | 广东睿江科技有限公司 | Method and device for setting file cache time |
| CN104133880B (en) * | 2014-07-25 | 2018-04-20 | 广东睿江云计算股份有限公司 | A kind of method and apparatus that the file cache time is set |
| CN105630819A (en) * | 2014-11-03 | 2016-06-01 | 阿里巴巴集团控股有限公司 | Cached data refreshing method and apparatus |
| CN105630819B (en) * | 2014-11-03 | 2019-06-11 | 阿里巴巴集团控股有限公司 | A kind of data cached method for refreshing and device |
| CN105677687A (en) * | 2014-11-21 | 2016-06-15 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN105653561A (en) * | 2014-12-02 | 2016-06-08 | 阿里巴巴集团控股有限公司 | Data processing method and apparatus |
| CN105653561B (en) * | 2014-12-02 | 2019-11-15 | 阿里巴巴集团控股有限公司 | The processing method and processing device of data |
| CN104572973A (en) * | 2014-12-31 | 2015-04-29 | 上海格尔软件股份有限公司 | High-performance memory caching system and method |
| CN106156061A (en) * | 2015-03-30 | 2016-11-23 | 北大方正集团有限公司 | A kind of method and device improving efficiency data query |
| CN106776666A (en) * | 2015-11-25 | 2017-05-31 | 北大方正集团有限公司 | Data cache method and device based on moodle websites |
| CN106776666B (en) * | 2015-11-25 | 2020-07-14 | 北大方正集团有限公司 | Data caching method and device based on mobile website |
| CN105447167A (en) * | 2015-12-04 | 2016-03-30 | 北京奇虎科技有限公司 | Processing method and apparatus for node cache data in distributed system |
| CN105447167B (en) * | 2015-12-04 | 2019-03-01 | 北京奇虎科技有限公司 | The data cached processing method and processing device of distributed system interior joint |
| CN105721538A (en) * | 2015-12-30 | 2016-06-29 | 东莞市青麦田数码科技有限公司 | Data access method and apparatus |
| CN106126356A (en) * | 2016-06-24 | 2016-11-16 | 努比亚技术有限公司 | The realization of a kind of server buffer, generation method and system |
| CN107622059A (en) * | 2016-07-13 | 2018-01-23 | 天脉聚源（北京）科技有限公司 | A kind of method and system for improving database search efficiency |
| CN106302829A (en) * | 2016-10-26 | 2017-01-04 | 腾讯音乐娱乐（深圳）有限公司 | A kind of information access method, device and server |
| CN106649585A (en) * | 2016-11-18 | 2017-05-10 | 福建中金在线信息科技有限公司 | Retrieval method and device |
| CN106777085A (en) * | 2016-12-13 | 2017-05-31 | 东软集团股份有限公司 | A kind of data processing method, device and data query system |
| CN106682202A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Search cache updating method and device |
| US11734276B2 (en) | 2016-12-29 | 2023-08-22 | Beijing Qiyi Century Science & Technology Co., Ltd. | Method and apparatus for updating search cache to improve the update speed of hot content |
| CN106682202B (en) * | 2016-12-29 | 2020-01-10 | 北京奇艺世纪科技有限公司 | Search cache updating method and device |
| WO2018209574A1 (en) * | 2017-05-16 | 2018-11-22 | 深圳中兴力维技术有限公司 | Alarm data query method and apparatus |
| CN107330119A (en) * | 2017-07-14 | 2017-11-07 | 掌阅科技股份有限公司 | Caching data processing method, electronic equipment, computer-readable storage medium |
| CN107562905A (en) * | 2017-09-08 | 2018-01-09 | 深圳市金立通信设备有限公司 | Management method, server and the computer-readable recording medium of data |
| CN110019263A (en) * | 2017-10-18 | 2019-07-16 | 北京京东尚科信息技术有限公司 | Information storage means and device |
| CN108874304B (en) * | 2018-03-30 | 2021-06-22 | 北京奇艺世纪科技有限公司 | Rule configuration method and device of cache system |
| CN108874304A (en) * | 2018-03-30 | 2018-11-23 | 北京奇艺世纪科技有限公司 | A kind of regular configuration method and device of caching system |
| CN111381917A (en) * | 2018-12-29 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Data reading and writing method and device |
| CN110347545A (en) * | 2019-05-21 | 2019-10-18 | 深圳壹账通智能科技有限公司 | A kind of test method and device of business platform cache policy |
| CN110222015A (en) * | 2019-06-19 | 2019-09-10 | 北京泰迪熊移动科技有限公司 | A kind of reading of file data, querying method, device and readable storage medium storing program for executing |
| CN110471939A (en) * | 2019-07-11 | 2019-11-19 | 平安普惠企业管理有限公司 | Data access method, device, computer equipment and storage medium |
| CN111127252A (en) * | 2019-12-24 | 2020-05-08 | 华中科技大学 | Data management method of water resource management decision support system |
| CN111737297A (en) * | 2020-06-15 | 2020-10-02 | 中国工商银行股份有限公司 | Method and device for processing link aggregation call information |
| CN111737297B (en) * | 2020-06-15 | 2023-08-25 | 中国工商银行股份有限公司 | Method and device for processing link aggregation call information |
| CN111858664B (en) * | 2020-06-23 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Data persistence method and system based on BMC |
| CN111858664A (en) * | 2020-06-23 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Data persistence method and system based on BMC |
| CN113139081A (en) * | 2021-04-27 | 2021-07-20 | 中山亿联智能科技有限公司 | Method for reporting and reading user online playing information with high efficiency and low delay |
| CN113139081B (en) * | 2021-04-27 | 2023-10-27 | 中山亿联智能科技有限公司 | Method for reporting online playing information of reading user with high efficiency and low delay |
| CN113691614A (en) * | 2021-08-23 | 2021-11-23 | 城云科技（中国）有限公司 | Information processing method and device |
| CN113691614B (en) * | 2021-08-23 | 2023-07-18 | 城云科技（中国）有限公司 | Information processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102902730B (en) | 2016-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102902730B (en) | Based on data reading method and the device of data buffer storage | |
| US11816083B2 (en) | Method and system for indexing of time-series data | |
| CN101576918B (en) | Data buffering system with load balancing function | |
| CN103177027B (en) | Obtain the method and system of dynamic Feed index | |
| CN111400308B (en) | Processing method of cache data, electronic device and readable storage medium | |
| CN103177062A (en) | Accelerated query operators for high-speed, in-memory online analytical processing queries and operations | |
| CN101668004A (en) | Method, device and system for acquiring webpage | |
| CN102156717B (en) | Method and device for mapping entity object into database | |
| CN104866434A (en) | Multi-application-oriented data storage system and data storage and calling method | |
| CN103885728A (en) | Magnetic disk cache system based on solid-state disk | |
| CN109977129A (en) | Multi-stage data caching method and equipment | |
| CN103747072A (en) | Data reading and writing method and application server | |
| CN111177178A (en) | Data processing method and related equipment | |
| CN104504158A (en) | Memory caching method and device for rapidly updating business | |
| CN109002543A (en) | A kind of method and apparatus of file storage | |
| CN111651519A (en) | Data synchronization method, data synchronization device, electronic device, and storage medium | |
| CN102929943B (en) | data output method and device | |
| CN115455058A (en) | Cache data processing method and device, computer equipment and storage medium | |
| CN103020077A (en) | Method for managing memory of real-time database of power system | |
| CN104408097A (en) | Hybrid indexing method and system based on character field hot update | |
| CN103970844A (en) | Big data write-in method and device, big data read method and device and big data processing system | |
| CN117009389A (en) | Data caching method, device, electronic equipment and readable storage medium | |
| CN103809915A (en) | Read-write method and device of magnetic disk files | |
| CN107679093B (en) | Data query method and device | |
| CN204926081U (en) | Data storae system towards multiple utility |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230412 Address after: Room 501-502, 5/F, Sina Headquarters Scientific Research Building, Block N-1 and N-2, Zhongguancun Software Park, Dongbei Wangxi Road, Haidian District, Beijing, 100193 Patentee after: Sina Technology (China) Co.,Ltd. Address before: 100080, International Building, No. 58 West Fourth Ring Road, Haidian District, Beijing, 20 floor Patentee before: Sina.com Technology (China) Co.,Ltd. |
|
| TR01 | Transfer of patent right |