News

Subscribe to News feed
Recent posts to news
Updated: 1 hour 32 min ago

First Release of gUSE Series 3.7

Thu, 12/04/2014 - 16:02

It sounds great: the brand new series of gUSE is started. The first version of this series, the version 3.7.0 contains three significant improvements:
First change is the introduction of Liferay 6.2 as new framework system to WS-PGRADE portal. This change involves some improvements in the Liferay-based portlet administration of WS-PGRADE and a minor change in appearance of the WS-PGRADE portal. Therefore, the WS-PGRADE portal is nicer and easier to administrate as earlier.
Second, there is a change in the Data Avenue-specific job configuration of WS-PGRADE: you can add robot certificate to your input file definition when you select the input by the help of Data Avenue. Additionally, you can use the Data Avenue not only in input definition but in executable settings of WS-PGRADE.
Third main improvement: Apache Tomcat 7, a.k.a the latest Tomcat version became the new application server of gUSE.
More details:
• in Chap. III, IV, and VII in Admin Manual
• in Chap 20 and 21 in User Manual.

First Release of gUSE Series 3.7

Thu, 12/04/2014 - 16:02

It sounds great: the brand new series of gUSE is started. The first version of this series, the version 3.7.0 contains three significant improvements:
First change is the introduction of Liferay 6.2 as new framework system to WS-PGRADE portal. This change involves some improvements in the Liferay-based portlet administration of WS-PGRADE and a minor change in appearance of the WS-PGRADE portal. Therefore, the WS-PGRADE portal is nicer and easier to administrate as earlier.
Second, there is a change in the Data Avenue-specific job configuration of WS-PGRADE: you can add robot certificate to your input file definition when you select the input by the help of Data Avenue. Additionally, you can use the Data Avenue not only in input definition but in executable settings of WS-PGRADE.
Third main improvement: Apache Tomcat 7, a.k.a the latest Tomcat version became the new application server of gUSE.
More details:
• in Chap. III, IV, and VII in Admin Manual
• in Chap 20 and 21 in User Manual.

A New Manual for gUSE Administration in the Cloud

Tue, 11/11/2014 - 12:45

A new manual was developed by the WS-PGRADE/gUSE Team to help
the cloud-specific administration of gUSE cloud access. The
Cloud-Specific Administration Guide is available in every release
documentation from version 3.6.8 in gUSE SourceForge site (guse.sf.net)

A New Manual for gUSE Administration in the Cloud

Tue, 11/11/2014 - 12:45

A new manual was developed by the WS-PGRADE/gUSE Team to help
the cloud-specific administration of gUSE cloud access. The
Cloud-Specific Administration Guide is available in every release
documentation from version 3.6.8 in gUSE SourceForge site (guse.sf.net)

EGI FedCloud Access

Fri, 10/03/2014 - 10:19

The greatest thing in the new gUSE version is the job submission support to clouds which have EGI Federated Cloud-based endpoints.
As you probably know, EGI a.k.a. European Grid Infrastructure provides access to high-throughput computing resources across Europe using grid and cloud computing techniques. The Federated Cloud (FedCloud) infrastructure, developed by EGI, is a seamless grid of academic private clouds and virtualized resources, built around open standards and focusing on the requirements of the scientific community.
Currently, the accessibility of three EGI FedCloud endpoints is tested and guaranteed from gUSE: the LPDS, the BIFI, and the CESNET FedCloud endpoints.
From now, you can easily and quickly create and submit your jobs by gUSE to three different cloud infrastructures: to CloudBroker platform, to Amazon EC2 cloud, and to EGI FedCloud.

EGI FedCloud Access

Fri, 10/03/2014 - 10:19

The greatest thing in the new gUSE version is the job submission support to clouds which have EGI Federated Cloud-based endpoints.
As you probably know, EGI a.k.a. European Grid Infrastructure provides access to high-throughput computing resources across Europe using grid and cloud computing techniques. The Federated Cloud (FedCloud) infrastructure, developed by EGI, is a seamless grid of academic private clouds and virtualized resources, built around open standards and focusing on the requirements of the scientific community.
Currently, the accessibility of three EGI FedCloud endpoints is tested and guaranteed from gUSE: the LPDS, the BIFI, and the CESNET FedCloud endpoints.
From now, you can easily and quickly create and submit your jobs by gUSE to three different cloud infrastructures: to CloudBroker platform, to Amazon EC2 cloud, and to EGI FedCloud.

XSEDE Support

Mon, 09/08/2014 - 10:24

We have a great news: from version 3.6.7 the WS-PGRADE/gUSE system supports the well-known XSEDE grid resource. From now you can easily submit jobs to XSEDE resource too.

Another important change in the new gUSE release is the direct integration of Data Avenue tool into the job configuration of WS-PGRADE/gUSE. Thus, you can conveniently use the capabilities of Data Avenue for remote job input and output definitions. (Note: The use of the Data Avenue-based job I/O function is currently guaranteed for the application of three storage protocols (SFTP, GSIFTP, and S3) and for four middleware types (local, gLite, CloudBroker, and EC2).

More details about XSEDE-support: in Portal User Manual (chapter 24 of Menu-Oriented Online Help) and in DCI Bridge Manual (section 5.21)).
More details about Data Avenue: in section 21.2 of Menu-Oriented Online Help in Portal User Manual.

XSEDE Support

Mon, 09/08/2014 - 10:24

We have a great news: from version 3.6.7 the WS-PGRADE/gUSE system supports the well-known XSEDE grid resource. From now you can easily submit jobs to XSEDE resource too.

Another important change in the new gUSE release is the direct integration of Data Avenue tool into the job configuration of WS-PGRADE/gUSE. Thus, you can conveniently use the capabilities of Data Avenue for remote job input and output definitions. (Note: The use of the Data Avenue-based job I/O function is currently guaranteed for the application of three storage protocols (SFTP, GSIFTP, and S3) and for four middleware types (local, gLite, CloudBroker, and EC2).

More details about XSEDE-support: in Portal User Manual (chapter 24 of Menu-Oriented Online Help) and in DCI Bridge Manual (section 5.21)).
More details about Data Avenue: in section 21.2 of Menu-Oriented Online Help in Portal User Manual.

Improved Cloud Access Solution

Tue, 06/24/2014 - 12:53

The cloud access (the EC2-based cloud access to be exact) is much more comfortable to use than it was in the previous versions. Additionally, you can simultaneously use several different clouds from the same portal. For example, Amazon and a private academic cloud can be used at the same time and the administrators don't need to install additional Euca2ools software to prepare a master DCI Bridge.

More details can be found:
- in chapter 18 within Menu-Oriented Online Help of Portal User Manual
- in section 5.19 within DCI Bridge Manual
- in chapter VI within Admin Manual.

Improved Cloud Access Solution

Tue, 06/24/2014 - 12:53

The cloud access (the EC2-based cloud access to be exact) is much more comfortable to use than it was in the previous versions. Additionally, you can simultaneously use several different clouds from the same portal. For example, Amazon and a private academic cloud can be used at the same time and the administrators don't need to install additional Euca2ools software to prepare a master DCI Bridge.

More details can be found:
- in chapter 18 within Menu-Oriented Online Help of Portal User Manual
- in section 5.19 within DCI Bridge Manual
- in chapter VI within Admin Manual.

SHIWA Submission Service

Thu, 05/22/2014 - 14:31

The most important change in gUSE 3.6.4 is to support the job submission by the so called SHIWA Submission Service.
The name SHIWA (SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs) comes from the FP7 SHIWA project that addresses the challenges of the coarse- and fine-grained workflow interoperability. The project created the SHIWA Simulation Platform that enables users to create and run embedded workflows which incorporate workflows of different workflow systems. The platform consists of the SHIWA Science Gateway and the SHIWA VO.
In the new development, the web service based SHIWA Submission Service replaces the old GT4-based GEMLCA Service and enables execution of different workflows from different communities developed in different workflow engines. Therefore you can use various workflows from various communities developed in various engines. All of these workflows are stored in a central workflow repository (called SHIWA Workflow Repository). These stored workflows you can explore by more tools: among others the WS-PGRADE offers for workflow browsing a runtime built-in look up tool, the SHIWA Explorer.
Having the SHIWA Submission Service, you can execute non-native workflows in a more reliable and secure way than with the GEMLCA Service.
More information:
- Portal User Manual, chapter 8 within Main part and chapter 23 within the Menu-Oriented Online Help
- Admin Manual, chapter VIII
- DCI Bridge Manual, chapter 2.10

SHIWA Submission Service

Thu, 05/22/2014 - 14:31

The most important change in gUSE 3.6.4 is to support the job submission by the so called SHIWA Submission Service.
The name SHIWA (SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs) comes from the FP7 SHIWA project that addresses the challenges of the coarse- and fine-grained workflow interoperability. The project created the SHIWA Simulation Platform that enables users to create and run embedded workflows which incorporate workflows of different workflow systems. The platform consists of the SHIWA Science Gateway and the SHIWA VO.
In the new development, the web service based SHIWA Submission Service replaces the old GT4-based GEMLCA Service and enables execution of different workflows from different communities developed in different workflow engines. Therefore you can use various workflows from various communities developed in various engines. All of these workflows are stored in a central workflow repository (called SHIWA Workflow Repository). These stored workflows you can explore by more tools: among others the WS-PGRADE offers for workflow browsing a runtime built-in look up tool, the SHIWA Explorer.
Having the SHIWA Submission Service, you can execute non-native workflows in a more reliable and secure way than with the GEMLCA Service.
More information:
- Portal User Manual, chapter 8 within Main part and chapter 23 within the Menu-Oriented Online Help
- Admin Manual, chapter VIII
- DCI Bridge Manual, chapter 2.10

Moving towards the Clouds

Fri, 01/31/2014 - 11:20

Thanks to the latest release of gUSE/WS-PGRADE, from now you can send your applications to run on cloud resources.

The gUSE/WS-PGRADE v3.6.2 provides you a new solution to directly access the clouds without brokering. You can also run your jobs on cloud resources by only using a valid user name and password to the corresponding cloud service.

Behind the scenes, the direct cloud access solution is based on the job submitter DCI Bridge distribution (the capability of job forwarding from master to slave DCI Bridge): the master DCI Bridge – that directly connected to gUSE – forwards the jobs through the Amazon EC2-based frontend service to the slave DCI Bridge – located in the cloud. Technically, the master DCI Bridge started - by the EC2-based service – a Virtual Machine that was created from an earlier saved image, containing the properly configured slave DCI Bridge.

Thanks to this new development, you can use cloud in the WS-PGRADE portal as ordinary resource type: you can create, configure and submit workflows just the way you always do.

More information:

Portal User Manual, chapter 21 within Menu-Oriented Online Help
Admin Manual, chapter VI
DCI Bridge Manual, chapter 2.18

Moving towards the Clouds

Fri, 01/31/2014 - 11:20

Thanks to the latest release of gUSE/WS-PGRADE, from now you can send your applications to run on cloud resources.

The gUSE/WS-PGRADE v3.6.2 provides you a new solution to directly access the clouds without brokering. You can also run your jobs on cloud resources by only using a valid user name and password to the corresponding cloud service.

Behind the scenes, the direct cloud access solution is based on the job submitter DCI Bridge distribution (the capability of job forwarding from master to slave DCI Bridge): the master DCI Bridge – that directly connected to gUSE – forwards the jobs through the Amazon EC2-based frontend service to the slave DCI Bridge – located in the cloud. Technically, the master DCI Bridge started - by the EC2-based service – a Virtual Machine that was created from an earlier saved image, containing the properly configured slave DCI Bridge.

Thanks to this new development, you can use cloud in the WS-PGRADE portal as ordinary resource type: you can create, configure and submit workflows just the way you always do.

More information:

Portal User Manual, chapter 21 within Menu-Oriented Online Help
Admin Manual, chapter VI
DCI Bridge Manual, chapter 2.18

Runtime Workflow Debugging

Fri, 11/08/2013 - 09:20

Do you want to directly influence and change your workflow’s submission process and result? Well, the recently released gUSE 3.6.1 gives you an appropriate solution.

If you want to interact with your workflows in runtime for tracing and debugging, you can use breakpoints. You can configure breakpoints to jobs in the WS-PGRADE within the main job configuration process and then during in the job submission process you can enable or prohibit the running of job instances at these breakpoints.

These breakpoints will be applied to all running instances of a job in the job submission process. During submission the gUSE/WS-PGRADE system runtime detects the defined breakpoints and it calls you when it reaches them. When you received the call about this event, you can enable or prohibit the continuation of the execution. You can stop the running of the job instance (e.g. for job reconfiguration), while you can enable running of another job instance in parallel (with other inputs and therefore with other results) of the same workflow instance.

Thanks to this new solution you can learn much more about your workflows and about what is happening in runtime. By tracing and debugging you are able to filter out the well-running and bad-running job instances in runtime to reach the desired workflow execution results.

For more details, please see the Portal User Manual (chapter 13) and the WS-PGRADE Cookbook (section Tips&Tricks).

Runtime Workflow Debugging

Fri, 11/08/2013 - 09:20

Do you want to directly influence and change your workflow’s submission process and result? Well, the recently released gUSE 3.6.1 gives you an appropriate solution.

If you want to interact with your workflows in runtime for tracing and debugging, you can use breakpoints. You can configure breakpoints to jobs in the WS-PGRADE within the main job configuration process and then during in the job submission process you can enable or prohibit the running of job instances at these breakpoints.

These breakpoints will be applied to all running instances of a job in the job submission process. During submission the gUSE/WS-PGRADE system runtime detects the defined breakpoints and it calls you when it reaches them. When you received the call about this event, you can enable or prohibit the continuation of the execution. You can stop the running of the job instance (e.g. for job reconfiguration), while you can enable running of another job instance in parallel (with other inputs and therefore with other results) of the same workflow instance.

Thanks to this new solution you can learn much more about your workflows and about what is happening in runtime. By tracing and debugging you are able to filter out the well-running and bad-running job instances in runtime to reach the desired workflow execution results.

For more details, please see the Portal User Manual (chapter 13) and the WS-PGRADE Cookbook (section Tips&Tricks).

A new journey starts on the Data Avenue

Tue, 09/17/2013 - 15:10

If you have ever wished that you could avoid using a command line tool to connect to your storage and would like to do it through a user-friendly interface or you need to transfer data between remote storages that use different protocols, then you should learn about Data Avenue.

We are glad to inform you that it is already available to try out! Also, in a new gUSE/WS-PGRADE version (v3.6.0) - that will be released shortly, about at the end of September - the Data Avenue portlet will be included. The new Data Avenue portlet will be connected to the so-called Data Avenue Blacktop core service that provides unified access to different types of storages. If you update your science gateway to this version, you will be able to use the Data Avenue through your usual user interface.

The Data Avenue operation is similar to a file commander: with Data Avenue, you can up- and download your data to storage services for scientific computation. Additionally, you can copy, move and delete files as well as you can create and copy folders. The biggest advantage of this solution is the widespread support of protocols, enabling the easy data moving between various DCI (such as grid, cloud, cluster, supercomputers) storage resources by various transfer protocols (HTTP, HTTPS, SFTP, GSIFTP, SRM, LFN).

If you would like to learn more or see how it works, you can try out the service on the Data Avenue website at http://data-avenue.eu.

If you are at the EGI Technical Forum, you should come to the SCI-BUS booth and ask for a demo.

A new journey starts on the Data Avenue

Tue, 09/17/2013 - 15:10

If you have ever wished that you could avoid using a command line tool to connect to your storage and would like to do it through a user-friendly interface or you need to transfer data between remote storages that use different protocols, then you should learn about Data Avenue.

We are glad to inform you that it is already available to try out! Also, in a new gUSE/WS-PGRADE version (v3.6.0) - that will be released shortly, about at the end of September - the Data Avenue portlet will be included. The new Data Avenue portlet will be connected to the so-called Data Avenue Blacktop core service that provides unified access to different types of storages. If you update your science gateway to this version, you will be able to use the Data Avenue through your usual user interface.

The Data Avenue operation is similar to a file commander: with Data Avenue, you can up- and download your data to storage services for scientific computation. Additionally, you can copy, move and delete files as well as you can create and copy folders. The biggest advantage of this solution is the widespread support of protocols, enabling the easy data moving between various DCI (such as grid, cloud, cluster, supercomputers) storage resources by various transfer protocols (HTTP, HTTPS, SFTP, GSIFTP, SRM, LFN).

If you would like to learn more or see how it works, you can try out the service on the Data Avenue website at http://data-avenue.eu.

If you are at the EGI Technical Forum, you should come to the SCI-BUS booth and ask for a demo.

First Look at gUSE

Mon, 09/09/2013 - 10:32

What kind of information can a user get who meets gUSE at the very first time? Where can you find answer for your essential question: What is this?

The ’gUSE in a Nutshell’ document was written to satisfy this basic user demand. It provides a big picture about gUSE and a quick overview that explains the ultimate gUSE capabilities and shows a basic architectural view. Additionally, this document introduces the workflow concept and the customization modes of gUSE. At the end of the overview you can find some interesting data about gUSE and a glossary for simple explanation of the most important terms.

Before you try out gUSE or read other longer and more detailed gUSE descriptions, start your journey at ‘gUSE in a Nutshell’.

The ‘gUSE in a Nutshell’ document can be found here: http://sourceforge.net/projects/guse/files/gUSE_in_a_Nutshell.pdf/download

First Look at gUSE

Mon, 09/09/2013 - 10:32

What kind of information can a user get who meets gUSE at the very first time? Where can you find answer for your essential question: What is this?

The ’gUSE in a Nutshell’ document was written to satisfy this basic user demand. It provides a big picture about gUSE and a quick overview that explains the ultimate gUSE capabilities and shows a basic architectural view. Additionally, this document introduces the workflow concept and the customization modes of gUSE. At the end of the overview you can find some interesting data about gUSE and a glossary for simple explanation of the most important terms.

Before you try out gUSE or read other longer and more detailed gUSE descriptions, start your journey at ‘gUSE in a Nutshell’.

The ‘gUSE in a Nutshell’ document can be found here: http://sourceforge.net/projects/guse/files/gUSE_in_a_Nutshell.pdf/download

Pages