Application Specific Module Tutorial Ákos Balaskó, Zoltán Farkas 04/17/2012 1

Outline 2 General Session: Goal gUSE orchestration Way from application to service Comparison Terminology Basic Idea Concept of ASM 2

Goal End users want to: Do not want to: Execute scientific applications Using distributed systems to: Decrease time cost Exploit storage & computational capacities use complex systems totally hidden Do not want to: learn any techniques that don't fit with scientific area of them → would like to use web-interfaces based on gUSE 3

Application Specific Interface gUSE orchestration Client side Remote access client WS-PGRADE 60% access of internal services Application Specific Interface 90% access of internal services Limited access 20% Full access ASM gUSE Remote access API Server side 4

Way from application to service Own Research Usage Types Our Suggestions Personal general gUSE Simple Application Complex Workflow Remote API Community Application Specific Module

Remote API vs. ASM Remote API: Pro: Cont: Servlet-technology Language-independent Hidden complexity Easy API Cont: Workflow must be on „client side” No workflow management Tight range of functionalities

Remote API vs. ASM ASM API: Pro: Cont: Wide range of functionalities Covers whole workflow-lifecycle Workflow management Hidden complexity Easy API Cont: Language-dependent (Java)

Terminology Grid Application Developer Grid Portal Developer would like to have a Portal customized for the application and end user community knows how to develop a grid application in gUSE/ws-PGrade or how to port a legacy application to the grid with gUSE/ws- PGrade Grid Portal Developer He knows the Java language and JSP (Java Server Pages) or other techniques (IceFaces etc) He does not need to know the source code of gUSE He and also the end users have user certificates to access the grid 8

Terminology Portal Administrator: Grid Application Developer installs gUSE Grid Application Developer Develops a grid application with gUSE Exports it to the local repository of gUSE Grid Portal Developer Develops an interface (in general a portlet) that fits to the application I/O pattern and the end users’ needs and associate it with the role Connects the GUI to gUSE using the programming API of Application Specific Module(ASM) End Users execute a copy of the exported application with custom input parameters 9

Basic idea A new module called “Application Specific Module” has been developed for gUSE that ease the creation of Application Specified Portlets The module provides programming API to control applications developed using gUSE The module provides programming API to access inner gUSE services Any kind of Graphical interface can be developed on top of this module GUI written in JSP, JSTL (Java Servlet Tag Library ) and Java GUI can be customized for the grid application GUI can be customized for end users 10

Desktop or Service grids / cloud / Clusters Concept Client Web browser ws-PGrade Internal components gUSE submitter Desktop or Service grids / cloud / Clusters DCIs 11 11

Concept We will focus on this! Client Web browser ws-PGrade Developed web-interface Internal components gUSE submitter Desktop or Service grids / cloud / Clusters DCIs 12 12

Developed web-interface Concept in details Client Web browser Web pages (JSP, JSF or other) Developed web-interface Configuration files (wsdd) JAVA event handler, and inner classes Application Specific Module API 13 13

Concept Client Web browser ws-PGrade Developed web-interface Internal components gUSE submitter Desktop or Service grids / cloud / Clusters DCIs 14 14

Concept in details ws-PGrade 15 gUSE DCI systems Submitter Workflow Interpreter Repository Workflow Storage Storage Information User space Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. DCI systems 15 15

Concept in details ws-PGrade 16 gUSE DCI systems Grid Application Developer creates own Grid Application via ws-PGrade and export it to the local repository gUSE Repository ws-PGrade Grid Application Submitter Workflow Interpreter Workflow Storage Storage Information User space Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. DCI systems 16 16

Developed web-interface Concept in details Then the Grid Portal Developer creates a new web-application (mainly an web-interface) which fits to the user community's needs, and connects it to the gUSE using ASM API gUSE ws-PGrade Developed web-interface ASM Repository Grid Application Submitter Workflow Interpreter Workflow Storage Storage Information User space Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. DCI systems 17 17

Developed web-interface Concept in details Finally the end-users create own application from the exported one, parameterize and execute it using the developed portlet gUSE ws-PGrade Developed web-interface ASM << import >> Storage Workflow Interpreter Repository User space Grid Application Information A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. Submitter Workflow Storage DCI systems 18 18

Developed web-interface Concept in details Finally the end-users create own application from the exported one, parameterize and execute it using the developed portlet gUSE ws-PGrade Developed web-interface ASM Storage Workflow Interpreter Repository User space Information Grid Application Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. Submitter Workflow Storage DCI systems 19 19

Developed web-interface Concept in details Finally the end-users create own application from the exported one, parameterize and execute it using the developed portlet gUSE ws-PGrade Developed web-interface ASM Storage Workflow Interpreter Repository User space Information Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. Submitter Workflow Storage DCI systems Grid Application 20 20

Developed web-interface Concept in details Finally the end-users create own application from the exported one, parameterize and execute it using the developed portlet gUSE ws-PGrade Developed web-interface ASM Storage Workflow Interpreter Repository User space Information Grid Application Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. Submitter Workflow Storage DCI systems 21 21

Developed web-interface Concept in details Then get back the results gUSE ws-PGrade Developed web-interface ASM Storage Workflow Interpreter Repository User space Information Ezt szet kene bontani tobb slidera, 1-1 slide minden szerepkornek A slideokon ne legyen “eltunes” effektus A slideokon ne legyen egymason tobb grafikus elem. Ha ilyen kene akkor azt egymas utan tobb slide beiktatasaval csinald meg. Submitter Workflow Storage DCI systems Grid Application 22 22

Technical details Provided functions:

Technical details Funcionality Method Return Type Description Get List of Workflow Developers getWorkflowDevelopers String[] get a stringlist of applivation Developer IDs that have exported at least one application to the local repository according to the necessary requirements (see ApplicationType object) Get ASM workflows getASMWorkflows List<ASMWor kflow> Returns a list of ASMWorkflow objects which are the applications of the user Import ImportWorkflow Void Imports an application from the local shared repository to the user space Download Output getFiletoPortalServer Downloads the needed file to the portal server getFileStream Stream Returns the file in a stream Upload uploadFiletoPortalServer Uploads a file to the portal server Associate a file for a port placeUploadedFile Place a file that has been already uploaded to portal server, in a workflow as an input file Submit submit Submits an imported application Get Status getWorkflows -> Overall status statistics in JobStatistics bean Gets general status statistics about the workflow that is being executed Get Detailed Status getDetails WorkflowInsta nceBean returns detailed status codes about every job that is being submitted according to the application (it returns) Rescue rescue ASMService Rescues an application Abort abort Aborts an application

End of General Session! Questions?