배치 Job Sample Project

1. 기본 설명

   이 예제는 Glue Job Scheduler 를 이용하지 않고 배치 Job 을 테스트하는 예제이다.

2. 사용법
   • 이클립스에 다운로드 받은 sample-schedule 프로젝트를 import 한다.

     (import - General - Existing Projects into Workspace)

   • applicationContext.xml 파일을 열어 datasource 부분을 로컬환경에 맞춰 수정한다.

     <!-- sqlite 의 경우 -->
     <bean id="test-dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
         <property name="driverClassName" value="org.sqlite.JDBC"/>
         <property name="url" value="jdbc:sqlite:/C://apache-tomcat-7.0.79/sample.db"/>  
         <property name="defaultAutoCommit" value="false"/>
         <property name="minIdle" value="0"/>
         <property name="maxActive" value="1"/>
         <property name="maxIdle" value="1000"/>
     </bean>
     <!-- oracle 일 경우
     <bean id="securityDs" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
         <property name="driverClassName" value="oracle.jdbc.driver.OracleDriver"/>
         <property name="url" value="jdbc:oracle:thin:@데이타베이스주소:1521:XE"/>
         <property name="username" value="아이디"/>
         <property name="password" value="비번"/>
         <property name="defaultAutoCommit" value="false"/>
         <property name="minIdle" value="0"/>
         <property name="maxActive" value="-1"/>
         <property name="maxIdle" value="1000"/>
     </bean>
     -->
     

   • Quartz 를 이용할 경우, quartz-scheduler.xml 를 활용.

     quartz-scheduler.xml 예시

     <?xml version="1.0" encoding="UTF-8"?>
     <beans xmlns="http://www.springframework.org/schema/beans"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://www.springframework.org/schema/beans
                             http://www.springframework.org/schema/beans/spring-beans-3.0.xsd">
         <bean id="scheduler" 
               class="org.springframework.scheduling.quartz.SchedulerFactoryBean" >
             <property name="triggers">
                 <list>
                     <ref local="simpleTrigger1"/>
                     <ref local="simpleTrigger2"/>
                     <ref local="cronTrigger"/>
                 </list>
             </property>
         </bean>
     
         <bean id="cronTrigger" class="org.springframework.scheduling.quartz.CronTriggerBean">
             <property name="jobDetail" ref="jobDetail-A"/>
             <property name="cronExpression" value="0 40 15 * * ?"/>
         </bean>
         <bean id="simpleTrigger1" 
               class="org.springframework.scheduling.quartz.SimpleTriggerBean">
             <property name="jobDetail" ref="jobDetail-B"/>
             <property name="repeatInterval" value="10000"/> 
             <property name="repeatCount" value="3"/>
             <property name="startDelay" value="5000"/>
         </bean>
         <bean id="simpleTrigger2" 
               class="org.springframework.scheduling.quartz.SimpleTriggerBean">
             <property name="jobDetail" ref="jobDetail-C"/>
             <property name="repeatInterval" value="7000"/>
         </bean>
     
         <bean id="jobDetail-A" class="org.springframework.scheduling.quartz.JobDetailBean">
             <property name="jobClass" 
                       value="com.poscoict.glueframework.scheduling.GlueQuartzJobBean"/>
             <property name="jobDataAsMap">
                 <map>
                     <entry key="ServiceName" value="hello-service"/>                
                     <entry key="input" value="Glue"/>
                 </map>
             </property>
         </bean>
         <bean id="jobDetail-B" class="org.springframework.scheduling.quartz.JobDetailBean">
             <property name="jobClass" 
                       value="com.poscoict.glueframework.scheduling.GlueQuartzJobBean"/>
             <property name="jobDataAsMap">
                 <map>
                     <entry key="ServiceName" value="dept-service"/>
                     <entry key="DEPTNO" value="60"/>
                     <entry key="DNAME" value="Testing"/>
                     <entry key="LOC" value="seoul"/>
                     <entry key="insert" value="event"/>
                 </map>
             </property>
         </bean>
         <bean id="jobDetail-C" class="org.springframework.scheduling.quartz.JobDetailBean">
             <property name="jobClass" 
                       value="com.poscoict.glueframework.scheduling.GlueQuartzJobBean"/>
             <property name="jobDataAsMap">
                 <map>
                     <entry key="ServiceName" value="dept-service"/>
                     <entry key="DEPTNO" value="60"/>
                     <entry key="delete" value="event"/>
                 </map>
             </property>
         </bean>
     </beans>
     

   • Spring Scheduler 를 이용할 경우, spring-scheduler.xml 를 활용.

     spring-scheduler.xml 예시

     <?xml version="1.0" encoding="UTF-8"?>
     <beans xmlns="http://www.springframework.org/schema/beans"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xmlns:task="http://www.springframework.org/schema/task"
         xsi:schemaLocation="http://www.springframework.org/schema/beans
                             http://www.springframework.org/schema/beans/spring-beans-3.0.xsd
                             http://www.springframework.org/schema/task
                             http://www.springframework.org/schema/task/spring-task.xsd">
     
         <task:scheduled-tasks scheduler="scheduler">
             <task:scheduled ref="glue-task-1" method="doGlueService" 
                                               cron="0/8 * * * * MON-FRI"/> 
             <task:scheduled ref="glue-task-2" method="doGlueService" fixed-rate="70000"/> 
             <task:scheduled ref="glue-task-3" method="doGlueService" fixed-delay="50000"/>
         </task:scheduled-tasks>
     
         <task:scheduler id="scheduler" pool-size="3" />
     
         <bean id="glue-task-1" 
               class="com.poscoict.glueframework.scheduling.task.GlueTaskScheduler">
             <property name="ServiceName" value="hello-service"/>
             <property name="dataMap">
                 <map>
                     <entry key="input" value="Glue"/>
                 </map>
             </property>
         </bean>
         <bean id="glue-task-2" 
               class="com.poscoict.glueframework.scheduling.task.GlueTaskScheduler">
             <property name="ServiceName" value="dept-service"/>
             <property name="dataMap">
                 <map>
                     <entry key="DEPTNO" value="50"/>
                     <entry key="DNAME" value="Marketing"/>
                     <entry key="LOC" value="SEOUL"/>
                     <entry key="insert" value="event"/>
                 </map>
             </property>
         </bean>
         <bean id="glue-task-3" 
               class="com.poscoict.glueframework.scheduling.task.GlueTaskScheduler">
             <property name="ServiceName" value="dept-service"/>
             <property name="dataMap">
                 <map>
                     <entry key="DEPTNO" value="50"/>
                     <entry key="delete" value="event"/>
                 </map>
             </property>
         </bean>
     </beans>
     

   • 외부 라이브러리가 추가 될 경우, build.xml 수정

     Oracle 을 이용할 경우, GlueSDK/lib 아래 gluestd_oracle 폴더 생성하고 라이브러리 위치시킴.

     <?xml version="1.0"?>
     <project name="GlueSchedulerSample" default="jar1">
         <!-- default 값을 패키징 유형에 따라 변경해서 ant build 실행 -->    
         <property file="build.properties"/>
         <target name="init" description="clean build directory before packaging">
             <delete failonerror="false">
                 <fileset dir="${build.dir}">
                     <include name="*.*"/>
                 </fileset>          
             </delete>
             <mkdir dir="${build.dir}"/>
             <mkdir dir="${build.dir}/lib"/>
         </target>
         <!-- Main-Class 생성, include schedule library path info
              jar1 : Main-Class 포함하며 quartz-scheduler.xml, spring-scheduler.xml 포함하는 jar packaging -->
         <path id="class.path1">        
             <fileset dir="${GlueSDK.dir}/lib/gluelib">
                 <include name="glue-core-*.jar"/>
                 <include name="glue-schema-*.jar"/>
                 <include name="glue-schedule-*.jar"/>
                 <include name="license-*.jar"/>
             </fileset>
             <fileset dir="${GlueSDK.dir}/lib/gluestd">
                 <include name="aopalliance*.jar"/>
                 <include name="bcprov*.jar"/>
                 <include name="xmlbeans*.jar"/>
                 <include name="jaxp-api*.jar"/>
                 <include name="spring*.jar"/>
                 <include name="ehcache*.jar"/>
                 <include name="slf4j*.jar"/>
                 <include name="logback*.jar"/>
                 <include name="jcl*.jar"/>
                 <include name="commons*.jar"/>
                 <include name="sqlite*.jar"/>
             </fileset>
             <fileset dir="${GlueSDK.dir}/lib/gluestd_schedule"><include name="*.jar"/></fileset>        
         </path>
         <pathconvert property="class-path1" pathsep=" " dirsep="\">
             <path refid="class.path1"></path>
             <map from="${GlueSDK.dir}/lib/gluelib" to="lib"/>
             <map from="${GlueSDK.dir}/lib/gluestd_schedule" to="lib"/>              
             <map from="${GlueSDK.dir}/lib/gluestd" to="lib"/>
         </pathconvert>
         <target name="jar1" depends="init" description="Creates the JAR file">
             <jar destfile="${build.dir}/${JAR1_NAME}.jar">
                 <manifest>
                     <section name="POSCO ICT Glue Sample Project">
                         <attribute name="Implementation-Version" value="${project_version}"/>
                     </section>
                     <attribute name="Main-Class" value="com.poscoict.glueframework.scheduling.server.GlueSchedulerHttpServer"/>
                     <attribute name="Class-Path" value="${class-path1}" />
                 </manifest>
                 <fileset dir="${class.dir}">
                     <patternset>
                         <include name="**/*.*"/>
                     </patternset>
                 </fileset>
             </jar>
             <!-- 로컬에서 테스트시에는 사용하고, 개발계등에서는 직접 라이브러리 복사 -->
             <copy todir="${build.dir}/lib">            
                 <fileset dir="${GlueSDK.dir}/lib/gluelib">
                     <include name="glue-core-*.jar"/>
                     <include name="glue-schema-*.jar"/>
                     <include name="glue-schedule-*.jar"/>
                     <include name="license-*.jar"/>
                 </fileset>
                 <fileset dir="${GlueSDK.dir}/lib/gluestd">
                     <include name="aopalliance*.jar"/>
                     <include name="bcprov*.jar"/>
                     <include name="xmlbeans*.jar"/>
                     <include name="jaxp-api*.jar"/>
                     <include name="spring*.jar"/>
                     <include name="ehcache*.jar"/>
                     <include name="slf4j*.jar"/>
                     <include name="logback*.jar"/>
                     <include name="jcl*.jar"/>
                     <include name="commons*.jar"/>
                     <include name="sqlite*.jar"/>
                 </fileset>
                 <fileset dir="${GlueSDK.dir}/lib/gluestd_schedule"><include name="*.jar"/></fileset>            
             </copy>
         </target>
         
         <!-- jar2 : user job packaging for using scheduler-server, 실행유형이 class 일 경우
         해당 jar 를 배치시키는 scheduler-server/apps/lib 아래에 class path 에 해당하는 library 들을 복사해야 함
         참고로 glue-scheduler-job-x.x.x.jar
         -->
         <path id="class.path2">        
             <fileset dir="${GlueSDK.dir}/lib/gluelib">
                 <include name="glue-core-*.jar"/>
                 <include name="glue-schema-*.jar"/>
                 <include name="glue-schedule-*.jar"/>
                 <include name="license-*.jar"/>
             </fileset>
             <fileset dir="${GlueSDK.dir}/lib/gluestd">
                 <include name="aopalliance*.jar"/>
                 <include name="bcprov*.jar"/>
                 <include name="xmlbeans*.jar"/>
                 <include name="jaxp-api*.jar"/>
                 <include name="spring*.jar"/>
                 <include name="ehcache*.jar"/>
                 <include name="slf4j*.jar"/>
                 <include name="logback*.jar"/>
                 <include name="jcl*.jar"/>
                 <include name="commons*.jar"/>
                 <include name="sqlite*.jar"/>
             </fileset>              
         </path>
         <pathconvert property="class-path2" pathsep=" " dirsep="\">
             <path refid="class.path2"></path>
             <map from="${GlueSDK.dir}/lib/gluelib" to="lib"/>                       
             <map from="${GlueSDK.dir}/lib/gluestd" to="lib"/>
         </pathconvert>
         <target name="jar2" depends="init" description="Creates the JAR file for scheduler-server">
             <jar destfile="${build.dir}/${JAR2_NAME}.jar">          
                 <fileset dir="${class.dir}">
                     <patternset>
                         <include name="**/*.*"/>
                         <exclude name="spring-scheduler.xml"/>
                         <exclude name="quartz-scheduler.xml"/>
                     </patternset>
                 </fileset>
             </jar>
         </target>
         
         <!-- jar3 : user job packaging for using scheduler-server, 실행유형이 jarfile 일 경우
         해당 jar 를 배치시키는 scheduler-server/apps/lib 아래에 class path 에 해당하는 library 들을 복사해야 함
         glue-scheduler-job-x.x.x.jar 도 class path 에 포함되게 ${GlueSDK.dir}/lib/gluestd_schedule 위치에 미리 복사해 둬야 함  
         -->
         <target name="jar3" depends="init" description="Creates the JAR file for scheduler-server">
             <jar destfile="${build.dir}/${JAR3_NAME}.jar">
                 <manifest>
                     <section name="POSCO ICT Glue Sample Project">
                         <attribute name="Implementation-Version" value="${project_version}"/>
                     </section>
                     <attribute name="Main-Class" value="com.poscoict.app.job.GlueSimpleJob"/>
                     <attribute name="Class-Path" value="${class-path1}" />
                 </manifest>
                 <fileset dir="${class.dir}">
                     <patternset>
                         <include name="**/*.*"/>
                         <exclude name="spring-scheduler.xml"/>
                         <exclude name="quartz-scheduler.xml"/>
                     </patternset>
                 </fileset>
             </jar>
         </target>
     </project>           
     

   • ant build 를 이용해 build 를 수행하면, 프로젝트내에 build 디렉토리 아래에 user-application.jar 가 생성된다.
   • Windows 의 경우 cmd 를 실행한 후, 해당 build 디렉토리로 이동.
   • Quartz 를 이용 할 경우,

     java -jar user-application.jar quartz quartz-scheduler.xml 로 실행.

   • Spring Scheduler 를 이용 할 경우,

     java -jar user-application.jar spring spring-scheduler.xml 로 실행.

   • 실행종료는 Ctrl+C 를 입력한다.
   • project attribute init 에 jar1, jar2, jar3 입력 후 build 수행 가능
   • jar1 은 배치성 job 을 quartz or spring 관련 xml 설정을 이용해 수행시
     jar2, jar3 은 scheduler-manager 를 통해 metadata 를 등록해 수행시 이용되는데
     jar2 의 경우는 실행유형이 class, jar3 의 경우는 실행유형이 jarfile 일 경우 이용