Skip to main content
All CollectionsManaging ContentManaging Challenges
Creating, Reviewing and Publishing Challenges
Creating, Reviewing and Publishing Challenges

This article provides detailed information related to challenge creation on FifthDomain platform.

FifthDomain avatar
Written by FifthDomain
Updated over a week ago

This article provides detailed information -

  • For users with “Create”, and “Manage Content” permission on how to create challenges.

  • For users with “Review” and “Manage Content” permission on how to review and publish challenges.

The article uses the term “content admin” for the affiliated user within the organisation who has “Manage Content” permission.

Overall Challenge Pipeline

For a challenge to be published in the organisation's Challenges library and ready for inclusion in competitions and assessments, it must undergo a thorough review process. Here's an overview of the pipeline:

  1. Creating a Challenge:
    Users start by filling out the challenge creation form, providing details such as challenge mapping, hints, labs, containers, attachments, and other relevant information.

  2. Saving Challenge as Draft (Optional):
    Users have the option to save the challenge as a draft. This allows them to revisit and make further edits before submitting it for review.

  3. Submitting Challenge for Review:
    Challenges are submitted for review by assigning up to 5 reviewers. The creator initiates this process, and the challenge enters the review stage where the reviewer, creator and content admin can provide feedback, and suggest and make edits.

  4. Editing Challenge In-Review, and Publishing It:
    During the review stage, the creator, reviewer, and content admin collaborate to make necessary edits and adjustments to the challenge. Once all feedback is addressed and the challenge meets the required standards, the Reviewer or Content Admin can approve/publish or disapprove the challenge.

  5. Published Challenges:
    Challenges that have successfully completed the review process and are published in the library are ready for use in competitions and assessments. Additionally, the content admin holds the authority to make edits to published challenges.

Accessing Challenges page

As an affiliated user of an organisation with Create or Manage Content permission, you create challenges within an organisation.

You can access the Challenges page through the side navigation bar by clicking Manage Content [1] and then selecting Challenges [2]. You can then click the Create a Challenge[3] button to create a challenge.

Creating a Challenge

The challenge form is divided into two sections:

  1. Details and Resources- This section has core challenge fields such as Name, Description, Solution etc. alongside resource materials such as Lab, attachments, etc.

  2. Mapping and Support Info- In this section, you'll find all mapping-related fields such as Professional Specialty, Skills, Techniques, etc., associated with the challenge. Additionally, it includes support elements such as Hints, Guided Walkthroughs, etc., which are provided to participants during events.

Section 1: Details and Resources

You can title your challenge by using the Name [1] text box. The Description [2] text box lets you add more information about your challenge. The Summary[3] text box lets you add a shorter description which is viewable only by admins/managers for quick reference and overview of the challenge for use-cases such as challenge curation for events, leasing challenges etc.

From the Proficiency[4] dropdown, you can select one out 5 available proficiency levels for the challenge. Proficiency level for a challenge is the required expertise required to solve a challenge ranging from Novice, Advanced Beginner, Competent, Proficient to Expert.

You can then use the Estimated Time to Solve [5] text box to give participants a guide on the number of minutes you expect it would take to solve the challenge.

You can add a flag for your challenge by typing it into the Flag text box. Flags can be written in the format of “FLAG{text}”, or you can use your own format.

Adding and Testing Lab

For Lab-based challenges, you can select and attach a pre-built Lab from your Organisation’s Lab list using the Select a Lab dropdown menu.

Once a Lab is attached, you have the option to test it directly within the challenge creation form. Ensure that you have downloaded the VPN configuration file onto your system, available in the "Add a Lab" section by clicking the Download VPN configuration file[2] button within the accordion[1].

Note: This file can also be accessed on the Manage Challenges page and needs to be downloaded only once onto your system to access the Test Lab.

Once you've configured the VPN, you can test the attached lab by clicking the Test Lab[3] button, which opens the lab in a new browser window.

If you decide to remove the lab, simply click the Remove Lab[4] button. Upon clicking, you'll be prompted to confirm your intention to remove the lab. It's important to note that this action only detaches the lab from the challenge being created; it does not remove it from the organisation’s Lab list. You can then choose to add a new lab or proceed without one, depending on your requirements.

You can upload .zip attachments to the challenge by clicking on the Upload button, as shown below.

You can search for a file to upload from your local drive by clicking the Browse [1] button. After you have selected a file, you can save the file by clicking the Save [2] button. Alternatively, you can cancel the upload process by clicking the Cancel [3] button.

You can add more attachments by clicking the Upload button again, and repeating the above process.

You can add the solution to your challenge by typing the solution in the Solution Walkthrough text field, as shown in the image below.

To move on to the next section, click Next[1] or click Cancel[2] to cancel the challenge creation.

Note : If you wish to save the changes you have made so far, you can click Next and you will find the option to save the challenge as Draft on the second page.

Section 2: Mapping and Support Info

Terminology

In this section, the challenge can be mapped to the right meta data including:

  • Professional Specialty-Professional specialties denote broad categories of cyber operations. Each challenge aligns with one of these specialties, providing a structured framework for classification.

  • Skills- Skills indicate the specific, acquired ability necessary to solve a challenge within a given timeframe or effort. Each challenge should necessitate one or two specific skills linked to the relevant professional specialty.

  • Techniques- Technologies include the environments (e.g., Windows, Linux, Docker) and tools (e.g., Splunk, Nessus, Python) incorporated within the challenge, crucial for its resolution.

  • Technologies-Techniques refer to the specific methods or strategies required to resolve a challenge. There is a preset list of techniques to select from, with the option to add more if needed.

Mapping the metadata

To start mapping, select one out of the 6 professional specialties listed.

Once you select a professional specialty[1], a list of skills linked to it will populate. Select the checkboxes[2] to select the skills that are most relevant to solve this challenge.

When you select the skills, separate input boxes appear to add techniques[3] for those skills.

There is another input box to add technologies[4].

To add techniques, you can start typing to get recommendations. As soon as you start typing, a dropdown will appear with the list of techniques that you can add from.

Simply select from the dropdown. The technique gets added in form of a chip in the input box[1]

If you don’t find a technique in the list, you can type a new one and press enter. You can also remove a chip by selecting close[2] icon on the chip.

Click Add[3] button to add techniques to the list of techniques the challenge will be mapped to.

Once added, the techniques added will be shown as chips. To remove a technique, simply click the cross on the chip.

Adding Hints

You can type your hint into the Text Box [1] that will appear on screen. To add your hint to your challenge, click the Add Hint [2] button. Alternatively, you can close the modal without adding a hint by clicking the Cancel [3] button.

You can add more hints be clicking on the Add Hint [1] button again and repeating the process outlined above. To delete a hint, click the Delete [2] button next to the hint you wish to delete. You can also edit a hint by clicking the Edit [3] button next to the hint you wish to edit. This will open a modal that operates in the same manner as Add Hint modal, described above.

Adding Guided Walkthrough for participants (optional)

This participant-facing walkthrough provides a comprehensive guide to the participants for solving a challenge. You can upload a video and add detailed step-by-step instructions for participants to reference alongside the video.

Using Upload Video Walkthrough[1] section, add the Vimeo embed code for the video.

Using Participant Walkthrough Solution Steps[2] text box, you can optionally add steps that will appear next to the video for the participants.

Saving Challenge as Draft

You can save a challenge as a draft at any stage after you have named the challenge by clicking the Save Draft button, shown below.

This is an optional step, and the challenge can be submitted for review directly without having saved it as a draft. The option to save a challenge as a draft is so that the challenge creator or content admin can revisit and make further edits before submitting it for review.

Editing a challenge in Draft

Under Draft[1] tab, you can find all the challenges you have created that are in draft state. If you have “Manage Content” permission, you will be able to see all the draft challenges in your organisation including those that have been created by someone else.

You can edit a draft challenge at any time by clicking the Actions [2] icon for the challenge and then selecting Edit [3].

Submitting Challenge for Review

After all mandatory fields are filled in the challenge form, the creator can submit the challenge for review by clicking Submit for Review button.

This brings up a modal, where the creator has to select at least one reviewer from the organisation. A reviewer within an organisation is an affiliated user with Review Content permission.

From the Select reviewer(s) for this challenge[1] dropdown, using checkboxes, select the reviewers in this organisation. The creator has an option of selecting up to 5 reviewers. The creator can also select oneself as a reviewer provided the creator has Review Content permission.

Click Assign Reviewer[2] button to confirm assigning selected users as reviewers and submitting the challenge for review, or click Cancel[3] to cancel the changes.

Important Notice:

Given that multiple reviewers may simultaneously work on a challenge, actions initiated by a reviewer, even if only a split second earlier, will take precedence over those of another reviewer concurrently engaged in the task.

For instance, in scenarios where multiple reviewers are editing the challenge simultaneously, changes saved by the first reviewer will be reflected before those saved by subsequent reviewers.

Additionally:

It's essential to acknowledge that actions like publishing or rejecting a challenge are irreversible. For example, if Reviewer A is editing a challenge and Reviewer B or a Content Admin publishes or rejects it before Reviewer A's changes are saved, Reviewer A's contributions will be lost, and the challenge will be published without those changes. In the event of rejection, the challenge will be permanently discarded.

Best Practices for Concurrent Reviewing:

  • Assigning multiple reviewers requires careful consideration, as they collectively shape an organisation's challenge library. Reviewers must be mindful of the potential impact of concurrent reviewing activities.

  • Furthermore, it's advisable for reviewers to clearly communicate their intentions, especially when executing irreversible actions like rejecting a challenge. Providing clarification in the comments section helps all participants in the review process understand the decisions being made.

Good to know:

Rejecting a lab-based challenge does not remove the attached Lab from your organisation's Lab library. The lab can be accessed via Content > Labs from the left navigation bar.
The Lab remains available for future use, allowing you to recreate a lab-based challenge using the same resources if needed.

Reviewing, Editing a Challenge In-Review, and Publishing It

In-Review Tab

You can find following challenges that are in-review in the In-Review tab on Manage Challenges page. The page is divided in two tables:

  1. Challenges to be reviewed by you[1]

    • If you've been designated as a reviewer for specific challenges, you'll find them listed in this table.

    • Here, you can view details such as the challenge creator, professional specialty, type, assigned tags, and more.

  2. Other challenges In-Review[2]

    • This table displays challenges you've created that are currently undergoing review.

    • Additionally, if you have the Manage Content permission, you'll have access to view all challenges in the organisation that are in the review stage, regardless of whether you created them.

    • Here, you can view details such as the challenge reviewers, professional specialty, type, assigned tags, and more.

Reviewing and Editing Challenges when you are assigned as the Reviewer

A Reviewer for a challenge is the affiliated user within an organisation who has been granted the Review-Content permission and has been assigned as a reviewer for challenge by the challenge creator.

To review the challenges for which you have been assigned as the reviewer, Under the I-Review[1] tab, in the Challenges to be reviewed by you[2] table, simply click the row action[3] icon and click Review[4] .

This brings up the In-Review challenge page, where you can check the challenge details, test any attached Lab or attachments, and referencing the solution walk-through, validate the correctness of the FLAG of the challenge.

There are 3 tabs on this page:

1. Details and Resources

In this tab[1], you'll find core challenge fields like Name, Description, Solution, along with resource materials such as Lab attachments, etc. As a reviewer, you won't have editing permissions for these details unless you also possess the Manage Content permission. However, you can still test attached Labs using the Test Lab[2] button and download attachments[3] for review.

2. Mapping and Support Info

This tab[1] contains mapping-related and support information such as hints for the challenge. As a reviewer, you can edit any field in this tab using the Edit[2] button next to each field.

After making edits, click on Save[1] button to save the changes, or Cancel[2] button to cancel the changes.

3. Comments and History

On this tab[1] , you'll find a list of all reviewers[2] for the challenge at the top. In the comments section, you can contribute to the comment thread using the text box[3]. This thread is accessible to the challenge creator and Content Admin as well.

In this thread[4], you'll also find a chronological record of actions related to the challenge, such as the date it was created, submitted for review, published, etc.

Editing Challenges In-Review

Content Admin and challenge creator have the ability to edit all details of a challenge in-review as opposed to the reviewer who can only edit mapping and support related info.

To edit an in-review challenge, simply click the row action[1] icon and click Edit[2] option in the “Other Challenges In-Review” table.

Additionally, the content-admin and creator are also able to edit the Reviewers list for a challenge by removing existing Reviewers using Remove[1] button, or add new Reviewers by using Add Reviewers[2] button.

Similar to the reviewer, the content admin and creator can also comment in the comment section using the text box[4] and view the thread[3] including the chronological record of actions related to the challenge, such as the date it was created, submitted for review, published, etc.

Publishing a Challenge

Once all feedback is addressed and the challenge meets the required standards, the Reviewer or Content Admin can approve/publish or disapprove the challenge.

To approve a challenge click on the Approve[1] button on the top right, and to disapprove a challenge, click Disapprove[2] button. In both instances, you would be prompted to confirm your decision.

On the Challenges[1] page, the approved challenge gets listed under the Published[2] tab, and the disapproved challenge gets listed under the Disapproved[3] tab.

Published Challenges

You can find all published challenges under the Published[1] tab.

If you have Manage Content permission, you can still edit a challenge after it is published by going to the Challenges page and clicking on the Actions [1] icon for the challenge and then selecting Edit [2].

Did this answer your question?