WO2005043388B1 - System and method for data transformation applications - Google Patents

System and method for data transformation applications

Info

Publication number
WO2005043388B1
WO2005043388B1 PCT/US2004/036554 US2004036554W WO2005043388B1 WO 2005043388 B1 WO2005043388 B1 WO 2005043388B1 US 2004036554 W US2004036554 W US 2004036554W WO 2005043388 B1 WO2005043388 B1 WO 2005043388B1
Authority
WO
WIPO (PCT)
Prior art keywords
map
data
dataflow
ports
component
Prior art date
Application number
PCT/US2004/036554
Other languages
French (fr)
Other versions
WO2005043388A1 (en
Inventor
Larry Lee Schumacher
Agustin Gonzales-Tuchmann
Laurence Tobin Yogman
Paul C Dingman
Original Assignee
Pervasive Software
Larry Lee Schumacher
Agustin Gonzales-Tuchmann
Laurence Tobin Yogman
Paul C Dingman
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pervasive Software, Larry Lee Schumacher, Agustin Gonzales-Tuchmann, Laurence Tobin Yogman, Paul C Dingman filed Critical Pervasive Software
Publication of WO2005043388A1 publication Critical patent/WO2005043388A1/en
Publication of WO2005043388B1 publication Critical patent/WO2005043388B1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores
    • G06F9/524—Deadlock detection or avoidance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/10—Requirements analysis; Specification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming

Abstract

A system and method for developing dataflow applications where a dataflow transformation is encapsulated into a dataflow graph expressed as a reusable map component using a host development language such as Java, and the dataflow graphs are linked together via ports. A map component may employ dynamic logic where internal sub-graphs or links are added or properties changed based on information received from the compiler, such as port types, design properties, or static data transformation. The dataflow application may be executed in a parallel processing environment by recognizing the linked data processes within the map components and assigning threads to the linked data processes. The execution environment monitors threads, detects and corrects deadlocks, logs and controls program exceptions and processes data input and output ports of the map components in parallel to take advantage of data partitioning schemes. Port implementation supports multi-state null value tokens to more accurately report exceptions.

Claims

AMENDED CLAIMS [received by the International Bureau on 08 May 2005 (18 05 05) original claims 1 , 9, 10 and 13 amended, original claim 4 cancelled
1 Λ system of managing data composing. a plui ality of map components, each map component compiising a configurable specification of n hicraic ical dataflow map family, and having one or more ports for acc pt mg data and foi producing datii and each map component independently synthesizing a particular dataflow pattern based on configuration; n compiler for oiganizing and linking said map components using said pol ls into a dataflow application; and ,m executor foτ creating links among map components in the dataflow application, lor bunching the dataflow application with data supplied to Ihc system, and for nssigning a thread to each map component wheit.by each map component executes independently iom the ot ei map components and the executor after launch.
2 li" system ot claim 1 , wherein at least one of the plurality of map components comprises a composite map component encapsulating a particular dataflow pattern using other map components as suhcnmponents.
3 1 he syslc of claim 1, wherein at least one of the plumb ty of map components comprises a scalar map component to pi ecss a specific data transfoimation.
5. '1 he system of claim 1, wherein the compiler is further for performing syntactic and semantic analysis.
6 1 he sy tem of clϊlim 1, wherein at least one map component cπrnpπses piopei ties determining map component design behavior.
7 The system of claim 1, at least one map component comprises properties that affect map component execution behavior.
8. The system of clqi 1, at least one of said ports supports multi-vnhied null data tokens.
0. A method For developing a dataflow application comprising,, developing one or more data tiansfoimaiions using a host language; assembling seveial data transformations having ports into a map component with links between ports using a declarative language for static assemblage and a host language for dynamic assemblage, compiling one or more map components with syntactic and semantic analysis; and synthesizing the compiled map components into an executable dataflow application including removing the design lime links between ports to pioduce a flat, nun-hierarcbical graph .
10. The method of claim 9, wherein the step of ,syn(hcs'i7ing the compiled map components comprises- synlhesi/.ing a liiciarchieul map component by allowing each map component to synthesize itself based on design timu propei Lics and input links; producing a fiat, non -hierarchical graph as the execution plan; and determining the executable dataflow application using rlie flattened execution plan in conjunction with runtime propci ties.
11. The method of claim 9, fuitlier comprising encrypting dataflow graphs piior to the step of compiling the m:ιp component
12. The rnethod of claim 9, wherein the host language is Java
13 Λ method for executing a dataflow application compiising: providing a dataflow application comprising a pluiahty of map components and data ports, a number of map components being linked between data ports and each map component compiising one or moiC processes; allocating a processing thread to each respective process; and executing multiple processes in parallel where each process executes independently from each other and the executor.
14, The method of claim 13, wheiein at least some of the plurality of map components include input ports and output poit.s, and wherein the step of executing multiple processes in paiallel comprises reading data tokens fiom icspcctivc input ports i»πd wi itiπg data tokens to respective output ports.
15. '1 he method of claim 13, wheiein the step ol allocating the processing thread comprises allocating at least one thread to a first process an at least one thread to a second process, wherein the first and second processes are connected through a queue via ports, and wherein the method fi.ii ther comprises: the thicdds cooperatively determining if a thread is blocked, waiting on another thiead, and determining if a blocked thread is sending data or receiving data without communication with the executor; and the thieads coopeniiively determining if a deadlock exists by building a wait graph of blocked threads in a parallel process data management system and determining if the wait giaph is cyclic, indicating a deadlock does exist without communication with the executor.
PCT/US2004/036554 2003-11-03 2004-11-03 System and method for data transformation applications WO2005043388A1 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US10/700,254 2003-11-03
US10/700,281 2003-11-03
US10/700,254 US7840949B2 (en) 2003-11-03 2003-11-03 System and method for data transformation using dataflow graphs
US10/700,281 US7743382B2 (en) 2003-11-03 2003-11-03 System for deadlock condition detection and correction by allowing a queue limit of a number of data tokens on the queue to increase
US10/700,152 2003-11-03
US10/700,152 US20080052687A1 (en) 2003-11-03 2003-11-03 Development environment for data transformation applications

Publications (2)

Publication Number Publication Date
WO2005043388A1 WO2005043388A1 (en) 2005-05-12
WO2005043388B1 true WO2005043388B1 (en) 2005-06-30

Family

ID=34557427

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2004/036554 WO2005043388A1 (en) 2003-11-03 2004-11-03 System and method for data transformation applications

Country Status (2)

Country Link
US (5) US20080052687A1 (en)
WO (1) WO2005043388A1 (en)

Families Citing this family (139)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050071135A1 (en) * 2003-09-30 2005-03-31 Vredenburgh David W. Knowledge management system for computer-aided design modeling
US20080052687A1 (en) * 2003-11-03 2008-02-28 Agustin Gonzales-Tuchmann Development environment for data transformation applications
US7562094B1 (en) 2003-12-31 2009-07-14 Precise Software Solutions, Inc. Object-level database performance management
US7698383B2 (en) * 2004-02-27 2010-04-13 Research In Motion Limited System and method for building component applications using metadata defined mapping between message and data domains
US7849183B1 (en) 2004-08-31 2010-12-07 Precise Software Solutions, Inc. Method of monitoring network and application performance by analyzing web clients and web servers
US7913206B1 (en) * 2004-09-16 2011-03-22 Cadence Design Systems, Inc. Method and mechanism for performing partitioning of DRC operations
US7774787B2 (en) * 2005-01-11 2010-08-10 Microsoft Corporation Method for specifying and verifying multi-threaded object-oriented programs with invariants
US7735089B2 (en) * 2005-03-08 2010-06-08 Oracle International Corporation Method and system for deadlock detection in a distributed environment
US8387052B2 (en) * 2005-03-14 2013-02-26 Qnx Software Systems Limited Adaptive partitioning for operating system
US8245230B2 (en) * 2005-03-14 2012-08-14 Qnx Software Systems Limited Adaptive partitioning scheduler for multiprocessing system
US9361156B2 (en) 2005-03-14 2016-06-07 2236008 Ontario Inc. Adaptive partitioning for operating system
CA2538503C (en) * 2005-03-14 2014-05-13 Attilla Danko Process scheduler employing adaptive partitioning of process threads
US7590978B2 (en) * 2005-04-15 2009-09-15 Microsoft Corporation Inferring object invariant method and system
EP1729213A1 (en) * 2005-05-30 2006-12-06 Honda Research Institute Europe GmbH Development of parallel/distributed applications
US7877350B2 (en) * 2005-06-27 2011-01-25 Ab Initio Technology Llc Managing metadata for graph-based computations
US7784035B2 (en) * 2005-07-05 2010-08-24 Nec Laboratories America, Inc. Method for the static analysis of concurrent multi-threaded software
US7904852B1 (en) 2005-09-12 2011-03-08 Cadence Design Systems, Inc. Method and system for implementing parallel processing of electronic design automation tools
US7702642B1 (en) * 2005-12-07 2010-04-20 Precise Software Solutions, Inc. Method, system and computer-readable code for instrumenting code for logging database-related strings
US20070150897A1 (en) * 2005-12-22 2007-06-28 International Business Machines Corporation Methods and apparatus for detecting deadlock in multithreading programs
US7702658B2 (en) * 2006-01-27 2010-04-20 International Business Machines Corporation Method for optimistic locking using SQL select, update, delete, and insert statements
US7519913B2 (en) 2006-06-01 2009-04-14 International Business Machines Corporation System and method for providing indicators of component interaction capability across navigation elements
US8448096B1 (en) 2006-06-30 2013-05-21 Cadence Design Systems, Inc. Method and system for parallel processing of IC design layouts
CA2657233C (en) * 2006-08-10 2016-06-21 Ab Initio Software Llc Distributing services in graph-based computations
US9262141B1 (en) * 2006-09-08 2016-02-16 The Mathworks, Inc. Distributed computations of graphical programs having a pattern
US7657856B1 (en) 2006-09-12 2010-02-02 Cadence Design Systems, Inc. Method and system for parallel processing of IC design layouts
GB2443277B (en) * 2006-10-24 2011-05-18 Advanced Risc Mach Ltd Performing diagnostics operations upon an asymmetric multiprocessor apparatus
US7774189B2 (en) * 2006-12-01 2010-08-10 International Business Machines Corporation System and method for simulating data flow using dataflow computing system
US8010954B2 (en) * 2007-02-14 2011-08-30 The Mathworks, Inc. Parallel programming interface to dynamically allocate program portions
US8225300B1 (en) * 2007-02-14 2012-07-17 The Mathworks, Inc. Client program executable on multiple heterogeneous server platforms
US8296430B2 (en) 2007-06-18 2012-10-23 International Business Machines Corporation Administering an epoch initiated for remote memory access
CN107423046B (en) * 2007-07-26 2021-08-06 起元技术有限责任公司 Method, system, and computer-readable medium for processing graph-based computations
US7941460B2 (en) * 2007-09-05 2011-05-10 International Business Machines Corporation Compilation model for processing hierarchical data in stream systems
US7860863B2 (en) * 2007-09-05 2010-12-28 International Business Machines Corporation Optimization model for processing hierarchical data in stream systems
US9065839B2 (en) * 2007-10-02 2015-06-23 International Business Machines Corporation Minimally buffered data transfers between nodes in a data communications network
US20090113308A1 (en) * 2007-10-26 2009-04-30 Gheorghe Almasi Administering Communications Schedules for Data Communications Among Compute Nodes in a Data Communications Network of a Parallel Computer
US20090125977A1 (en) * 2007-10-31 2009-05-14 Docomo Communications Laboratories Usa, Inc. Language framework and infrastructure for safe and composable applications
US9218166B2 (en) * 2008-02-20 2015-12-22 Embarcadero Technologies, Inc. Development system with improved methodology for creation and reuse of software assets
US8201067B2 (en) * 2008-02-25 2012-06-12 International Business Machines Corporation Processor error checking for instruction data
US8806426B2 (en) * 2008-06-04 2014-08-12 Microsoft Corporation Configurable partitioning of parallel data for parallel processing
US8499287B2 (en) * 2008-06-23 2013-07-30 Microsoft Corporation Analysis of thread synchronization events
US8392633B2 (en) * 2008-06-25 2013-03-05 Hewlett-Packard Development Company, L.P. Scheduling requesters of a shared storage resource
US8161380B2 (en) * 2008-06-26 2012-04-17 International Business Machines Corporation Pipeline optimization based on polymorphic schema knowledge
US9026993B2 (en) 2008-06-27 2015-05-05 Microsoft Technology Licensing, Llc Immutable types in imperitive language
US8627306B2 (en) * 2008-08-06 2014-01-07 Caterpillar Inc. Method and system for updating an information management system configuration
US8495603B2 (en) * 2008-08-11 2013-07-23 International Business Machines Corporation Generating an executable version of an application using a distributed compiler operating on a plurality of compute nodes
US8316357B2 (en) * 2008-09-03 2012-11-20 Microsoft Corporation Type descriptor management for frozen objects
US20100077384A1 (en) * 2008-09-23 2010-03-25 Microsoft Corporation Parallel processing of an expression
US8302076B2 (en) * 2008-11-12 2012-10-30 Landmark Graphics Corporation Systems and methods for improved parallel ILU factorization in distributed sparse linear systems
KR20150042866A (en) * 2008-12-02 2015-04-21 아브 이니티오 테크놀로지 엘엘시 Mapping instances of a dataset within a data management system
US20100162205A1 (en) * 2008-12-23 2010-06-24 Cisco Technology, Inc. Apparatus and method for automatically generating capability statements for management interfaces
KR20150038758A (en) 2009-02-13 2015-04-08 아브 이니티오 테크놀로지 엘엘시 Managing task execution
US8239847B2 (en) * 2009-03-18 2012-08-07 Microsoft Corporation General distributed reduction for data parallel computing
US8306980B2 (en) * 2009-04-09 2012-11-06 International Business Machines Corporation Flexible and extensible framework and model for systems manageable components
US8434075B1 (en) * 2009-04-15 2013-04-30 Teradata Us, Inc. Branching optimization in a multi-database system
US9569282B2 (en) 2009-04-24 2017-02-14 Microsoft Technology Licensing, Llc Concurrent mutation of isolated object graphs
US8554745B2 (en) 2009-04-27 2013-10-08 Netapp, Inc. Nearstore compression of data in a storage system
US8250530B2 (en) * 2009-05-27 2012-08-21 Microsoft Corporation Composite values for declarative language applications
EP2478433A4 (en) * 2009-09-16 2016-09-21 Ab Initio Technology Llc Mapping dataset elements
US8667329B2 (en) * 2009-09-25 2014-03-04 Ab Initio Technology Llc Processing transactions in graph-based applications
US8316369B2 (en) 2009-12-29 2012-11-20 Microsoft Corporation Dataflow component scheduling using reader/writer semantics
US8695003B2 (en) 2009-12-29 2014-04-08 Microsoft Corporation Method for managing data accessibility by scheduling three types of executable agents associated with pre-defined access rights within a domain
US8566544B2 (en) 2009-12-29 2013-10-22 Microsoft Corporation Compiler-enforced agent access restriction
US8606979B2 (en) * 2010-03-29 2013-12-10 International Business Machines Corporation Distributed administration of a lock for an operational group of compute nodes in a hierarchical tree structured network
US8365186B2 (en) 2010-04-14 2013-01-29 International Business Machines Corporation Runtime optimization of an application executing on a parallel computer
US8676818B2 (en) * 2010-05-03 2014-03-18 International Business Machines Corporation Dynamic storage and retrieval of process graphs representative of business processes and extraction of formal process models therefrom
US8555265B2 (en) * 2010-05-04 2013-10-08 Google Inc. Parallel processing of data
CA2801573C (en) 2010-06-15 2018-08-14 Ab Initio Technology Llc Dynamically loading graph-based computations
US8504730B2 (en) 2010-07-30 2013-08-06 International Business Machines Corporation Administering connection identifiers for collective operations in a parallel computer
US8769496B2 (en) 2010-08-13 2014-07-01 Accenture Global Services Limited Systems and methods for handling database deadlocks induced by database-centric applications
AU2011323773B2 (en) 2010-10-25 2015-07-23 Ab Initio Technology Llc Managing data set objects in a dataflow graph that represents a computer program
US8549464B2 (en) 2010-11-22 2013-10-01 Microsoft Corporation Reusing expression graphs in computer programming languages
US8699344B2 (en) 2010-12-15 2014-04-15 At&T Intellectual Property I, L.P. Method and apparatus for managing a degree of parallelism of streams
US8565120B2 (en) 2011-01-05 2013-10-22 International Business Machines Corporation Locality mapping in a distributed processing system
US9418095B2 (en) 2011-01-14 2016-08-16 Ab Initio Technology Llc Managing changes to collections of data
US9317637B2 (en) 2011-01-14 2016-04-19 International Business Machines Corporation Distributed hardware device simulation
US9280439B2 (en) * 2011-02-11 2016-03-08 Sap Se Usage analysis of productive environment to establish new data source for process optimization and project planning
US8689228B2 (en) 2011-07-19 2014-04-01 International Business Machines Corporation Identifying data communications algorithms of all other tasks in a single collective operation in a distributed processing system
US9250948B2 (en) 2011-09-13 2016-02-02 International Business Machines Corporation Establishing a group of endpoints in a parallel computer
US8893080B2 (en) 2012-08-15 2014-11-18 Telefonaktiebolaget L M Ericsson (Publ) Parallelization of dataflow actors with local state
US10489360B2 (en) 2012-10-17 2019-11-26 Ab Initio Technology Llc Specifying and applying rules to data
US9280396B2 (en) * 2012-11-01 2016-03-08 Netapp, Inc. Lock state synchronization for non-disruptive persistent operation
US9507682B2 (en) 2012-11-16 2016-11-29 Ab Initio Technology Llc Dynamic graph performance monitoring
US10108521B2 (en) 2012-11-16 2018-10-23 Ab Initio Technology Llc Dynamic component performance monitoring
US20140143762A1 (en) * 2012-11-21 2014-05-22 Fujitsu Limited Symbolic execution of dynamic programming languages
US9274926B2 (en) 2013-01-03 2016-03-01 Ab Initio Technology Llc Configurable testing of computer programs
CN105683940A (en) * 2013-06-24 2016-06-15 惠普发展公司，有限责任合伙企业 Processing a data flow graph of a hybrid flow
US9495199B2 (en) 2013-08-26 2016-11-15 International Business Machines Corporation Management of bottlenecks in database systems
WO2015085152A1 (en) 2013-12-05 2015-06-11 Ab Initio Technology Llc Managing interfaces for dataflow graphs composed of sub-graphs
WO2015094269A1 (en) * 2013-12-19 2015-06-25 Hewlett-Packard Development Company, L.P. Hybrid flows containing a continuous flow
US9235388B2 (en) * 2014-02-13 2016-01-12 Red Hat, Inc. Multi-dimensional, multi-configuration compilation phase output visualization technique
WO2015171117A1 (en) * 2014-05-06 2015-11-12 Hewlett-Packard Development Company, L.P. Backend analysis and transformation
US10853356B1 (en) 2014-06-20 2020-12-01 Amazon Technologies, Inc. Persistent metadata catalog
US9659394B2 (en) 2014-06-30 2017-05-23 Microsoft Technology Licensing, Llc Cinematization of output in compound device environment
US9356913B2 (en) * 2014-06-30 2016-05-31 Microsoft Technology Licensing, Llc Authorization of joining of transformation chain instances
US9396698B2 (en) 2014-06-30 2016-07-19 Microsoft Technology Licensing, Llc Compound application presentation across multiple devices
US9773070B2 (en) 2014-06-30 2017-09-26 Microsoft Technology Licensing, Llc Compound transformation chain application across multiple devices
EP3742284A1 (en) 2014-07-18 2020-11-25 AB Initio Technology LLC Managing lineage information
US9223551B1 (en) * 2014-07-22 2015-12-29 Here Global B.V. Rendergraph compilation method and use thereof for low-latency execution
US10146828B2 (en) * 2014-07-23 2018-12-04 Battelle Memorial Institute System and method of storing and analyzing information
US9189215B1 (en) * 2014-08-26 2015-11-17 National Instruments Corporation Convergence analysis of program variables
US10176273B2 (en) * 2014-08-27 2019-01-08 Verizon Patent And Licensing Inc. Big data parser
JP6479966B2 (en) * 2014-09-02 2019-03-06 アビニシオ テクノロジー エルエルシー Visual definition of a subset of components in a graph-based program through user interaction
US9626393B2 (en) 2014-09-10 2017-04-18 Ab Initio Technology Llc Conditional validation rules
US10296348B2 (en) 2015-02-16 2019-05-21 International Business Machines Corproation Delayed allocation of an out-of-order queue entry and based on determining that the entry is unavailable, enable deadlock avoidance involving reserving one or more entries in the queue, and disabling deadlock avoidance based on expiration of a predetermined amount of time
US10191828B2 (en) * 2015-05-07 2019-01-29 Vmware, Inc. Methods and apparatus to control a monitoring agent in a computing environment
US9733915B2 (en) 2015-07-02 2017-08-15 Microsoft Technology Licensing, Llc Building of compound application chain applications
US9860145B2 (en) 2015-07-02 2018-01-02 Microsoft Technology Licensing, Llc Recording of inter-application data flow
US9712472B2 (en) 2015-07-02 2017-07-18 Microsoft Technology Licensing, Llc Application spawning responsive to communication
US9658836B2 (en) 2015-07-02 2017-05-23 Microsoft Technology Licensing, Llc Automated generation of transformation chain compatible class
US10198252B2 (en) 2015-07-02 2019-02-05 Microsoft Technology Licensing, Llc Transformation chain application splitting
US10261985B2 (en) 2015-07-02 2019-04-16 Microsoft Technology Licensing, Llc Output rendering in dynamic redefining application
US9733993B2 (en) 2015-07-02 2017-08-15 Microsoft Technology Licensing, Llc Application sharing using endpoint interface entities
US9785484B2 (en) 2015-07-02 2017-10-10 Microsoft Technology Licensing, Llc Distributed application interfacing across different hardware
US10031724B2 (en) 2015-07-08 2018-07-24 Microsoft Technology Licensing, Llc Application operation responsive to object spatial status
US20170010758A1 (en) * 2015-07-08 2017-01-12 Microsoft Technology Licensing, Llc Actuator module for building application
US10198405B2 (en) 2015-07-08 2019-02-05 Microsoft Technology Licensing, Llc Rule-based layout of changing information
US10657134B2 (en) 2015-08-05 2020-05-19 Ab Initio Technology Llc Selecting queries for execution on a stream of real-time data
US10277582B2 (en) 2015-08-27 2019-04-30 Microsoft Technology Licensing, Llc Application service architecture
EP3394739B1 (en) * 2015-12-21 2020-11-11 AB Initio Technology LLC Sub-graph interface generation
US10768975B2 (en) * 2016-03-04 2020-09-08 Ricoh Company, Ltd. Information processing system, information processing apparatus, and information processing method
US10025566B1 (en) * 2016-10-07 2018-07-17 The Mathworks, Inc. Scheduling technique to transform dataflow graph into efficient schedule
US11290572B2 (en) * 2016-11-07 2022-03-29 Constructive Labs System and method for facilitating sharing of virtual three-dimensional space
US11277494B1 (en) 2016-11-27 2022-03-15 Amazon Technologies, Inc. Dynamically routing code for executing
US11138220B2 (en) * 2016-11-27 2021-10-05 Amazon Technologies, Inc. Generating data transformation workflows
US11481408B2 (en) 2016-11-27 2022-10-25 Amazon Technologies, Inc. Event driven extract, transform, load (ETL) processing
US10545979B2 (en) 2016-12-20 2020-01-28 Amazon Technologies, Inc. Maintaining data lineage to detect data events
US10769180B2 (en) 2017-02-02 2020-09-08 International Business Machines Corporation Efficient dataflow processing for objects
US11194551B2 (en) * 2017-06-07 2021-12-07 Ab Initio Technology Llc Dataflow graph configuration
US11423083B2 (en) 2017-10-27 2022-08-23 Ab Initio Technology Llc Transforming a specification into a persistent computer program
US10853131B2 (en) * 2017-11-20 2020-12-01 Salesforce.Com, Inc. Dataflow life cycles
US10581891B1 (en) * 2017-11-27 2020-03-03 Lacework Inc. Using graph-based models to identify datacenter anomalies
US11275485B2 (en) * 2018-06-15 2022-03-15 Sap Se Data processing pipeline engine
US11126411B2 (en) * 2018-12-13 2021-09-21 Sap Se Dashboard user interface for data driven applications
US10831563B2 (en) * 2019-03-19 2020-11-10 International Business Machines Corporation Deadlock resolution between distributed processes using process and aggregated information
JP7330742B2 (en) * 2019-04-19 2023-08-22 キヤノン株式会社 IMAGE PROCESSING APPARATUS, CONTROL METHOD AND PROGRAM FOR SETTING PROPERTIES ON SCANNED IMAGES
US20210191845A1 (en) * 2019-12-23 2021-06-24 Ab Initio Technology Llc Unit testing of components of dataflow graphs
EP4097583A1 (en) * 2020-01-28 2022-12-07 AB Initio Technology LLC Editor for generating computational graphs
CN115668125A (en) * 2020-08-31 2023-01-31 麦姆瑞克斯公司 Memory processing unit architecture mapping techniques
CN116501504B (en) * 2023-06-27 2023-09-12 上海燧原科技有限公司 Space-time mapping method and device for data stream, electronic equipment and storage medium

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4145733A (en) * 1974-03-29 1979-03-20 Massachusetts Institute Of Technology Data processing apparatus for highly parallel execution of stored programs
WO1990014629A2 (en) * 1989-05-26 1990-11-29 Massachusetts Institute Of Technology Parallel multithreaded data processing system
US5293631A (en) * 1991-08-06 1994-03-08 Hewlett-Packard Company Analysis and optimization of array variables in compiler for instruction level parallel processor
US5404558A (en) * 1992-02-17 1995-04-04 Sharp Kabushiki Kaisha Data driven type information processor having a plurality of memory banks
US5313454A (en) * 1992-04-01 1994-05-17 Stratacom, Inc. Congestion control for cell networks
US5675807A (en) * 1992-12-17 1997-10-07 Tandem Computers Incorporated Interrupt message delivery identified by storage location of received interrupt data
US5838894A (en) * 1992-12-17 1998-11-17 Tandem Computers Incorporated Logical, fail-functional, dual central processor units formed from three processor units
US5517656A (en) * 1993-06-11 1996-05-14 Temple University Of The Commonwealth System Of Higher Education Multicomputer system and method
US5764976A (en) * 1995-02-06 1998-06-09 International Business Machines Corporation Method and system of deadlock detection in a data processing system having transactions with multiple processes capable of resource locking
US5758184A (en) * 1995-04-24 1998-05-26 Microsoft Corporation System for performing asynchronous file operations requested by runnable threads by processing completion messages with different queue thread and checking for completion by runnable threads
US6311265B1 (en) 1996-03-25 2001-10-30 Torrent Systems, Inc. Apparatuses and methods for programming parallel computers
US5822300A (en) * 1996-04-02 1998-10-13 Compaq Computer Corporation Congestion management scheme
US5802310A (en) * 1996-05-30 1998-09-01 International Business Machines Corporation Systems and methods for data channel queue control in a communications network
US6330008B1 (en) * 1997-02-24 2001-12-11 Torrent Systems, Inc. Apparatuses and methods for monitoring performance of parallel computing
US5999729A (en) * 1997-03-06 1999-12-07 Continuum Software, Inc. System and method for developing computer programs for execution on parallel processing systems
US6031835A (en) * 1997-04-04 2000-02-29 International Business Machines Corporation Method for deadlock free and and reliable routing in a packet switched network
US6088716A (en) * 1997-04-28 2000-07-11 Ab Initio Software Corporation Method for preventing buffer deadlock in dataflow computations
US6058466A (en) * 1997-06-24 2000-05-02 Sun Microsystems, Inc. System for allocation of execution resources amongst multiple executing processes
US6505296B2 (en) * 1997-10-13 2003-01-07 Hewlett-Packard Company Emulated branch effected by trampoline mechanism
US6424624B1 (en) * 1997-10-16 2002-07-23 Cisco Technology, Inc. Method and system for implementing congestion detection and flow control in high speed digital network
US7095852B2 (en) * 1998-02-13 2006-08-22 Tecsec, Inc. Cryptographic key split binder for use with tagged data elements
US6195793B1 (en) * 1998-07-22 2001-02-27 International Business Machines Corporation Method and computer program product for adaptive inlining in a computer system
US6378066B1 (en) * 1999-02-04 2002-04-23 Sun Microsystems, Inc. Method, apparatus, and article of manufacture for developing and executing data flow programs, and optimizing user input specifications
US6449711B1 (en) * 1999-02-04 2002-09-10 Sun Microsystems, Inc. Method, apparatus, and article of manufacture for developing and executing data flow programs
US6542991B1 (en) * 1999-05-11 2003-04-01 Sun Microsystems, Inc. Multiple-thread processor with single-thread interface shared among threads
US6449619B1 (en) * 1999-06-23 2002-09-10 Datamirror Corporation Method and apparatus for pipelining the transformation of information between heterogeneous sets of data sources
US6847947B1 (en) * 2000-01-18 2005-01-25 First Data Corporation Method and system for reduced cost debit processing
JP2001222564A (en) * 2000-02-09 2001-08-17 Hitachi Ltd Logic emulation system
AU2001257403A1 (en) * 2000-04-26 2001-11-07 The Trustees Of Columbia University In The City Of New York A low latency fifo circuit for mixed clock systems
US6631460B1 (en) * 2000-04-27 2003-10-07 Institute For The Development Of Emerging Architectures, L.L.C. Advanced load address table entry invalidation based on register address wraparound
US6874141B1 (en) * 2000-06-29 2005-03-29 Microsoft Corporation Method of compiling schema mapping
US20020178432A1 (en) * 2000-08-17 2002-11-28 Hyungwon Kim Method and system for synthesizing a circuit representation into a new circuit representation having greater unateness
JP3933380B2 (en) * 2000-10-05 2007-06-20 富士通株式会社 compiler
US6691301B2 (en) * 2001-01-29 2004-02-10 Celoxica Ltd. System, method and article of manufacture for signal constructs in a programming language capable of programming hardware architectures
DE60107828T2 (en) * 2001-06-18 2005-06-16 Alcatel Flow and blockage control in a switched network
US7124405B1 (en) * 2001-06-28 2006-10-17 Microsoft Corporation Class initialization method semantics
GB0118294D0 (en) * 2001-07-27 2001-09-19 Ibm Method and system for deadlock detection and avoidance
US6947947B2 (en) * 2001-08-17 2005-09-20 Universal Business Matrix Llc Method for adding metadata to data
US6918030B2 (en) * 2002-01-10 2005-07-12 International Business Machines Corporation Microprocessor for executing speculative load instructions with retry of speculative load instruction without calling any recovery procedures
US7286547B2 (en) * 2002-05-09 2007-10-23 Broadcom Corporation Dynamic adjust multicast drop threshold to provide fair handling between multicast and unicast frames
US7093262B2 (en) * 2002-07-30 2006-08-15 Intel Corporation Detecting deadlocks in multithreaded programs
US7203632B2 (en) * 2003-03-14 2007-04-10 Xilinx, Inc. HDL co-simulation in a high-level modeling system
US20080052687A1 (en) * 2003-11-03 2008-02-28 Agustin Gonzales-Tuchmann Development environment for data transformation applications
US20100025238A1 (en) * 2008-07-31 2010-02-04 Medtronic Minimed, Inc. Analyte sensor apparatuses having improved electrode configurations and methods for making and using them

Also Published As

Publication number Publication date
US7840949B2 (en) 2010-11-23
US20110004880A1 (en) 2011-01-06
US20070271562A1 (en) 2007-11-22
US8528000B2 (en) 2013-09-03
US8429631B2 (en) 2013-04-23
US7743382B2 (en) 2010-06-22
US20080052687A1 (en) 2008-02-28
WO2005043388A1 (en) 2005-05-12
US20050097561A1 (en) 2005-05-05
US20100262968A1 (en) 2010-10-14

Similar Documents

Publication Publication Date Title
WO2005043388B1 (en) System and method for data transformation applications
Bonachea et al. GASNet Specification, v1. 8.1
Charousset et al. Revisiting actor programming in C++
US9424010B2 (en) Extraction of functional semantics and isolated dataflow from imperative object oriented languages
Chrysanthakopoulos et al. An asynchronous messaging library for c
CN112119423A (en) System and method for formal verification
US9652301B2 (en) System and method providing run-time parallelization of computer software using data associated tokens
Pagano et al. A model based safety critical flow for the aurix multi-core platform
US20090007115A1 (en) Method and apparatus for parallel XSL transformation with low contention and load balancing
Dearle et al. A component-based model and language for wireless sensor network applications
Hiesgen et al. OpenCL Actors–Adding Data Parallelism to Actor-Based Programming with CAF
Jagadeesan et al. Quarantining weakness: compositional reasoning under relaxed memory models
CN116724292A (en) Parallel processing of thread groups
Panyala et al. On the use of term rewriting for performance optimization of legacy HPC applications
Henrio et al. Active objects with deterministic behaviour
Behera et al. StarPlat: A Versatile DSL for Graph Analytics
Srinivasan Kilim: A server framework with lightweight actors, isolation types and zero-copy messaging
Chalabine et al. Crosscutting concerns in parallelization by invasive software composition and aspect weaving
Jacobs et al. Modular termination verification: extended version
Heller Extending the C++ Asynchronous Programming Model with the HPX Runtime System for Distributed Memory Computing
Yao et al. Mapping Petri nets to concurrent programs in CC++
White Runtime techniques for efficient execution of virtualized, migratable MPI ranks
Anand et al. Synthesizing and verifying multicore parallelism in categories of nested code graphs
US20230367604A1 (en) Method of interleaved processing on a general-purpose computing core
Amighi et al. Resource protection using atomics: Patterns and verifications

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

B Later publication of amended claims

Effective date: 20050518

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase