Apache CloudStack Examination
Introducing how we developed the CloudStack exam -‐ ACCEL -‐ in Japan.
CloudStack Collaboration Conference in EuropeDublin, Ireland October 8, 2015
Who am I
Midori Oge@star76popin
Chairman of Japan CloudStack Users GroupSystems Engineer, SolidFire Inc.
Japan CloudStack Users GroupOur purpose is to promote CloudStack through sharing experiences and information using CloudStack in Japanese.
events
appeared on radio
AdventCalendar
study meeting
book reading
What is ACCEL ?
What is ACCEL?• ACCEL Stands for Apache CloudStack Certification Examby LPI-‐Japan
• ACCEL is provided by LPI-‐Japan to promote cloud technology and develop engineers. They distribute “LPIC” which is the most popular IT certification in Japan.
• Certified people have the skill and knowledge required to build, operate and maintain CloudStack based IT infrastructure
• Japan CloudStack Users Group supported the development of this exam
Why ACCEL?The following issues are often encountered during the expansion of the cloud market.• Development of engineer resources is not keeping up
• difficult to ensure high level cloud engineers
• Showing the differentiation with other companies is difficult because companies can not prove the
technical level of employees
ACCEL is is very effective especially in Japan, since certification is an importantelement in various business fields
Linux Job Report 2015 by Linux Foundation❝Forty-‐two percent of hiring managers say experience with or knowledge of OpenStack and CloudStack are having a big impact on their hiring decisions.❞
Target• Cloud service providers, System integrators, implementing and operating private cloud systems
• improvingskill in developing and operating infrastructure of internal cloud
• people in charge of IT systems who are considering migrating IT systemsto public cloud services
• people who want further skills as cloud engineer
Examination System• 60 questions in 90 minutes• CBT (Computer Based Test)• Multiple choice (4-‐5)• Target Apache CloudStack Version:4.4• Passing score: more than 60% of the total• Validity of the certification: 3 years• Pre requirements: none (LPIC1 certified level recommended)• Average learning period : 1-‐3 months• Price: 15,000 JPY
Once you are certifiedEarning certification helps you gain visibility for your proven experience, such as• Using the functions of CloudStack effectively depends on the purpose of use.• Implementing CloudStack systems while understanding the functions, the limitations, and choosing the appropriate architecture model
• Understanding system status and getting the information needed for failure isolation methods • Contributing to CloudStack’s development through translation and reporting bugs
CertificateCertification Card
How we developed
Development FlowPlan
•Scheduling•Deciding on team members for developing examination•Preparing communication tool
Design
• CreatingGuidelines and glossary• Defining JTA(Job Task Analysis), scope of targets, setting priorities
Development
• Questions writing and screening, technical reviews• Review of neutrality• Beta test and reflection on feedback
Prepare for release
•Registrationof exam•Press Release
※ Approved by board of Directors of LPI-‐Japan
April 2014
※
※
※
June 1st 2015 release
May 2014
June 2014
December2014
Communication Chart•問題レビューLPI-‐JapanGen Narui, Makoto Ono, Kazuko Itoda, Toru Nakatani, Takashi Imoto
Management
LPI DirectorsFujitsu, Hitachi, NEC Solution Innovators(alphabetical order)
Inspection
Japan CloudStack Users GroupMidori Oge, Tadashi Mishima
Lead of developing examination
Japan CloudStack Users GroupSatoshi Shimazaki, Go Chiba, Satoru Nakaya, Chihiro Hirata, Ai Onikata, Takuma Nakajima, Kimihiko Kitase, Masayuki Hayashi, Atsushi Sasaki, NatsukiWatanabe, Mayumi Koshimizu
Exam CreatorPEARSON VUE
Distributor
Plan
Communication Tool• We used REDMINE to provide information and manage exam data• Exam Creator issues a ticket on REDMINE to submit exam data, after that Exam Developer checks it and send back some comments.
• Inquiry• Submission of exam data
• Provide Information• Provide guidelines• Arrange schedule• Request for correction• Meeting agenda
Exam Creator Lead developer
• Guideline• JTA• Glossary• Schedule• Examinations• Meeting note
Plan
Create the GuidelinesCreate Guidelines to clarify certification objectives
• Why get certified?• What is the value of certification?
• Who is the target?• What kind of exam should we create?
Design
Define JTA
• JTA (Job Task Analysis)make a list of skill sets needed to have field experience for implementing and operating cloud systems using CloudStack= prove the certified people have enough work-‐ready skills and experience
After the skill set was defined, we sorted the skills into sections and decided on the ratio for each section.
Design
DesignJTANo MajorItems
No. Sub Items No. Key knowledgearea Keyword Required Skill Ratio
1 General Knowledge 1.1
OverviewApache CloudStack
1.1.1 Apache CloudStack ・Whatʼ’s Apache CloudStack?・License of Apache CloudStack
Understanding the overview Apache CloudStack and license system 10%
2The architecture of CloudStack
2.1The architectureof componentsand functions
2.1.1 Composition of components
・Cluster・Pod・Zone・Region
Understanding the role of components
40%
2.1.2 Management Server, Host, Storage
・Hardware and OS requirements・Hypervisors(VMWare vSphere, KVM, XenServer, Hyper-‐‑‒V)・Management Server・DatabaseServer・Host・Primary Storage・Secondary Storage・Usage Server
Understanding the functions and architecture of Management Server and Host, Storage
2.1.3 System VM, Virtual Router
・Console Proxy VM・Secondary Storage VM・Virtual Router・DHCP, DNS. StaticNAT,VPN, LoadBalancer・Firewall, PortForwarding
Understanding the functionsand architecture of System VM and Virtual Router
2.2Designing system and implementing
2.2.1 Whole design, Definition of requirements
・Sizing – Zone, Pod, Cluster, Host, Storage・Over Provisioning・Host Tag, Storage Tag・VM allocation algorism
Ability to design and define the requirements to implement cloud systems
2.2.2 Network Design
・NetworkModel・Physical Network・Network – Public, Guest, Management, Storage・Designing IP Address・Traffic Label・Connect to existing environments
Understanding the Network Model and ability to design networks
2.2.3 System Reliability・Availability of Management Server・Availability of Database Server・Fault Recovery and Disaster Recovery
Understanding the reliability of cloud systems and ability to design redundancy and backup
2.2.4 Installation and implementing
・Initial settings – Management Server, Host, Database, Storage・Preparing System VM Template
Having the knowledge for installation and initial settings and customization for own environments
DesignNo Major
ItemsNo. Sub Items No. Key knowledgearea Keyword Required Skill Ratio
3 How to use CloudStack
3.1 Web user interface
3.1.1 VM and Volumes・VM・Volume・Template, ISO・Snapshot
Ability to operate VM and Volumes
30%
3.1.2 Network・Guest Network・Security Group・VPC
Ability to customize networks as needed
3.1.3 User・User・Account・Domain・Project
Understanding the structure of managingusers and ability to manage the required resources
3.1.4 Monitoring ・Dashboard・Event Understanding the status of resources and event logs
3.2 Admin user interface
3.2.1 Difference of Web UI behavior by privilege ・Difference of Web UI behavior by privilege Understanding the difference of Web UI behavior by privilege
3.2.2 Global Settings ・Global Settings Understanding the effect of the settings and parameters on all of the systems and ability to set them
3.2.3 Service Offerings・Computing Offering・System Offering・Disk Offering・Network Offering
Ability to define and manage the necessary resources usingservice offerings
4
Oparation, Monitoring,otherutilization methods
4.1 Operation, Monitoring4.1.1 Operation, Monitoring
・Start and Stop・Maintenance mode・Backup・Version UP・Usage monitoring
Ability to operate self-‐‑‒built cloud systems properly
20%4.1.2 Troubleshooting ・log・case study of troubles Ability to isolate the cause of troubles and find out the recovery action
4.2 API 4.2.1 API・privilege of executing API・how to use API・synchronize/asynchronize command
Ability to do a range of operations using API
JTA
Exam creation and screening• Exam creation policy
create exam questions while assuming the knowledge that is required when working in the field
• The following are examples of undesirable questions - Asking for knowledge which is not related to CloudStack- Asking about commercial version specific features- Including the vender names and product names (the hypervisor name is excluded)- Asking about the possibility to be changed in the future- Asking only about sentence structure rather than about the content , or trap questions- Questions with subjective answers
e.g. Why is CloudStack better than OpenStack?e.g. What are the points to be most careful about when set to XX?
development
Create
Review
Update
Review
Complete
• Questions were created, updated many times through screening
Improving the quality1. Set the difficulty level of each questions2. Beta test (several times)3. Modify the difficulty level based on the result of beta test
e.g.) Raise the difficulty level if more than 90% of people answered correctlye.g.) Reduce the difficulty level if more than 90% of people answered incorrectlye.g.) Replace easy questions that many people answered correctly and difficult questions that many people answered incorrectlye.g.) Change easy questions to multiple-‐selection from single-‐selectione.g.) Change difficult questions to single-‐selection from multiple selection
4. Compare with the difficulty level which was set before and re-‐set the difficulty and re-‐place
5. Discuss with the stakeholders based on the survey results of the beta test
development
Registration• Changed the format for distribution the exam
• Developed the tool to change the format
Preparefor
release
item 1.123 cardinality = “single” correct-‐response = B min-‐response = 1max-‐response = 1presentation = [Which of the following is the valid operation that can be done thru Web User Interface by Domain Administrator ?<choice ident = “A”>Create sub domain<choice ident = “B”>Change the number of the resource to be allocated to Sub Domain<choice ident = “C”>Assign the dedicated host to the account<choice ident = “D”>Add the LDAP accounts]
Finally released!!
Highlights and Lowlights• Highlights
- Our ties were deepened through this project- Since all members had to create exam questions in their free time, we saved development time by using the chosen communication tool and glossary
• lowlights- Since it was our first attempt, it took much more time than expected in the “designing” and “preparing for release” stages
This certification was released through our communityʼ’s efforts.It also was a very valuable experience for all of us.
Next steps• Preparing the next revision• Considering frequency and management method of revision• Publication of educational books and planning training courses
• The English version will be released this month!!=> Please give us any feedback and comments
Sample QuestionFrom Objective: 3.2.1 -‐ Web UI Difference by privilegeWhich of the following is a valid operation that can be done through Web User Interface by Domain Administrator ?A. Create Sub DomainB. Change the number of resources to be allocated to Sub DomainC. Assign a dedicated host to the accountD. Add the LDAP accounts
Thank you !!