دانلود مقاله ISI انگلیسی شماره 108344
ترجمه فارسی عنوان مقاله

پرس و جوهای داده خام در هنگام اجرای عملیات موازی موقت داده

عنوان انگلیسی
Raw data queries during data-intensive parallel workflow execution
کد مقاله سال انتشار تعداد صفحات مقاله انگلیسی
108344 2017 21 صفحه PDF
منبع

Publisher : Elsevier - Science Direct (الزویر - ساینس دایرکت)

Journal : Future Generation Computer Systems, Volume 75, October 2017, Pages 402-422

ترجمه کلمات کلیدی
جریان های علمی، گردش داده ها، تجزیه و تحلیل داده های خام، فهرست داده های خام،
کلمات کلیدی انگلیسی
Scientific workflows; Dataflow; Raw data analysis; Index raw data;
پیش نمایش مقاله
پیش نمایش مقاله  پرس و جوهای داده خام در هنگام اجرای عملیات موازی موقت داده

چکیده انگلیسی

Computer simulations consume and produce huge amounts of raw data files presented in different formats, e.g., HDF5 in computational fluid dynamics simulations. Users often need to analyze domain-specific data based on related data elements from multiple files during the execution of computer simulations. In a raw data analysis, one should identify regions of interest in the data space and retrieve the content of specific related raw data files. Existing solutions, such as FastBit and RAW, are limited to a single raw data file analysis and can only be used after the execution of computer simulations. Scientific Workflow Management Systems (SWMS) can manage the dataflow of computer simulations and register related raw data files at a provenance database. This paper aims to combine the advantages of a dataflow-aware SWMS and the raw data file analysis techniques to allow for queries on raw data file elements that are related, but reside in separate files. We propose a component-based architecture, named as ARMFUL (Analysis of Raw data from Multiple Files) with raw data extraction and indexing techniques, which allows for a direct access to specific elements or regions of raw data space. ARMFUL innovates by using a SWMS provenance database to add a dataflow access path to raw data files. ARMFUL facilitates the invocation of ad-hoc programs and third party tools (e.g., FastBit tool) for raw data analyses. In our experiments, a real parallel computational fluid dynamics is executed, exploring different alternatives of raw data extraction, indexing and analysis.