|
|
>>>
|
|
|
## WebLab Wiki Index
|
|
|
|
|
|
- __WebLab__ (this page)
|
|
|
* **WebLab** (this page)
|
|
|
|
|
|
[[_TOC_]]
|
|
|
[[_TOC_]]
|
|
|
|
|
|
* [__Assignment Visibility and Deadlines__](WebLab/Assignment-Visibility-and-Deadlines)
|
|
|
* [__Examination in WebLab__](WebLab/Examination-in-WebLab)
|
|
|
* [__Exam Ticket Setup__](WebLab/Exam-Tickets)
|
|
|
* [__Announcements and Discussions__](WebLab/Announcements-and-Discussions)
|
|
|
* [__Grading in WebLab__](WebLab/Grading-in-WebLab)
|
|
|
* [__WebLab Support__](WebLab/Support)
|
|
|
>>>
|
|
|
|
|
|
* [**Assignment Visibility and Deadlines**](WebLab/Assignment-Visibility-and-Deadlines)
|
|
|
* [**Examination in WebLab**](WebLab/Examination-in-WebLab)
|
|
|
* [**Exam Ticket Setup**](WebLab/Exam-Tickets)
|
|
|
* [**Announcements and Discussions**](WebLab/Announcements-and-Discussions)
|
|
|
* [**Grading in WebLab**](WebLab/Grading-in-WebLab)
|
|
|
* [**WebLab Support**](WebLab/Support)
|
|
|
|
|
|
>>>
|
|
|
|
|
|
## The WebLab platform
|
|
|
WebLab (https://weblab.tudelft.nl) is a learning management system developed at the EEMCS/Software Technology dept/Programming Languages group. It supports various types of assignments (e.g., Multiple Choice, Open Question, Programming Question, File Submission Question) with automated and/or manual grading. On top of that, (remote) exams with built-in tooling to minimize fraud can be held by means of exam tickets, individual question order per student, timed questions, a randomly picked question from a set of question variants, and RPNow proctoring support.
|
|
|
|
|
|
WebLab (<https://weblab.tudelft.nl>) is a learning management system developed at the EEMCS/Software Technology dept/Programming Languages group. It supports various types of assignments (e.g., Multiple Choice, Open Question, Programming Question, File Submission Question) with automated and/or manual grading. On top of that, (remote) exams with built-in tooling to minimize fraud can be held by means of exam tickets, individual question order per student, timed questions, a randomly picked question from a set of question variants, and RPNow proctoring support.
|
|
|
|
|
|
## Add Your Course to WebLab
|
|
|
|
|
|
- Sign in using _TU Delft Single Sign On_
|
|
|
- Open the [new course request page](https://weblab.tudelft.nl/newcourserequest) (in top menu: '**About**' -> '**Your Course in WebLab?**').
|
|
|
- To submit a request, fill in the '**Course Code**', the '**Course Name**', and an explanation on what you would like to use/try WebLab for in the '**Request**' section.
|
|
|
- When the WebLab administrators have accepted your request, you will receive notification. You can then start setting up your course.
|
|
|
|
|
|
#### Set Up Course Dates/Course Rules
|
|
|
- After you've browsed the newly created course edition after being accepted by the administrators, click '**Edit Edition**' in the course navigation bar up top.
|
|
|
<img src="uploads/0536c815e9b231a257fe3765008375a8/nav-edit-edition.png" width="500px" />
|
|
|
- Here you can set the dates to when the course should be accessible for enrolment by students. Furthermore, a '**Description**', '**Rules**', and other additional settings (e.g., group size) for the course can be set here as well.
|
|
|
<img src="uploads/86e945572e736b0a451b11932f3bda03/edit-edition.png" height="250px"/>
|
|
|
|
|
|
- After you've browsed the newly created course edition after being accepted by the administrators, click '**Edit Edition**' in the course navigation bar up top.\
|
|
|
![](uploads/0536c815e9b231a257fe3765008375a8/nav-edit-edition.png)
|
|
|
- Here you can set the dates to when the course should be accessible for enrolment by students. Furthermore, a '**Description**', '**Rules**', and other additional settings (e.g., group size) for the course can be set here as well.\
|
|
|
![](uploads/86e945572e736b0a451b11932f3bda03/edit-edition.png)
|
|
|
|
|
|
#### Set Up Course Staff
|
|
|
There are 4 functional roles within WebLab for course staff: Observer, Reviewer, Grader and Manager. You need to be **Manager** in order to create course content. **Observer**s can view all student submissions (for staff who assist students during the course). **Grader**s (and **Reviewer**s) may grade student submissions and constitute the pool of graders to which submissions get assigned for grading.
|
|
|
- Open "Edit Staff"
|
|
|
<img src="uploads/2b3269cd53c39ffad66b280339d60e96/nav-edit-staff.png" width="500px" />
|
|
|
- Add course staff by typing the name of the person to be added. This person should have logged on WebLab once before being listed here.
|
|
|
<img src="uploads/9ce6187eee5b2298fc0f53bdaecdafc7/enter-staff.png" width="500px" />
|
|
|
|
|
|
There are 4 functional roles within WebLab for course staff: Observer, Reviewer, Grader and Manager. You need to be **Manager** in order to create course content. **Observer**s can view all student submissions (for staff who assist students during the course). **Grader**s (and **Reviewer**s) may grade student submissions and constitute the pool of graders to which submissions get assigned for grading.
|
|
|
|
|
|
- Open "Edit Staff"\
|
|
|
![](uploads/2b3269cd53c39ffad66b280339d60e96/nav-edit-staff.png)
|
|
|
- Add course staff by typing the name of the person to be added. This person should have logged on WebLab once before being listed here.\
|
|
|
![](uploads/9ce6187eee5b2298fc0f53bdaecdafc7/enter-staff.png)
|
|
|
|
|
|
## Creating Assignments
|
|
|
- Browse to Assignments from the course edition page
|
|
|
<img src="uploads/5f71a7101dcd63f6aeff3810b462f882/nav-assignments.png" height="250px" />
|
|
|
- From here you can start adding (folders of) assignments.
|
|
|
<img src="uploads/aa71185db35b0cb3c58febbc8e53d320/nav-create-assignment.png" width="500px" />
|
|
|
- Enter a name for the assignment you want to create, and pick the assignment type from the menu below.
|
|
|
<img src="uploads/f4ab421858913b8f068a60f03c375045/create-assignment-modal.png" width="250px" />
|
|
|
|
|
|
- Browse to Assignments from the course edition page\
|
|
|
![](uploads/5f71a7101dcd63f6aeff3810b462f882/nav-assignments.png)
|
|
|
- From here you can start adding (folders of) assignments.\
|
|
|
![](uploads/aa71185db35b0cb3c58febbc8e53d320/nav-create-assignment.png)
|
|
|
- Enter a name for the assignment you want to create, and pick the assignment type from the menu below.\
|
|
|
![](uploads/f4ab421858913b8f068a60f03c375045/create-assignment-modal.png)
|
|
|
|
|
|
#### Assignment types
|
|
|
The following types of assignments are available:
|
|
|
|
|
|
The following types of assignments are available:
|
|
|
| Type | auto. gr. | man. gr. | Description |
|
|
|
| ------ | ------ | ------ | ------ |
|
|
|
| **Multiple-Choice** | :ballot_box_with_check: | :ballot_box_with_check: | Multiple Choice questions have a question text and can have any number _n_ of alternatives, from which _m_ correct ones. A student answer is correct when all, or at least _y < m_ (configurable), correct alternatives are chosen, and no incorrect alternatives are chosen. Students score a `10.0` when answered correctly, `0.0` otherwise. |
|
|
|
| **Essay/Open Question** | | :ballot_box_with_check: | Students are asked to submit a textual answer. Text markup is available through markdown syntax, and Latex/MathML through MathJax. A live preview is shown while answering the question. <br/>Grading is done manually, i.e. using grading rubrics in form of checklist items with weights, or grade-based components (0.0-10.0). |
|
|
|
|------|-----------|----------|-------------|
|
|
|
| **Multiple-Choice** | :ballot_box_with_check: | :ballot_box_with_check: | Multiple Choice questions have a question text and can have any number _n_ of alternatives, from which _m_ correct ones. A student answer is correct when all, or at least _y < m_ (configurable), correct alternatives are chosen, and no incorrect alternatives are chosen. Students score a `10.0` when answered correctly, `0.0` otherwise. |
|
|
|
| **Essay/Open Question** | | :ballot_box_with_check: | Students are asked to submit a textual answer. Text markup is available through markdown syntax, and Latex/MathML through MathJax. A live preview is shown while answering the question. <br>Grading is done manually, i.e. using grading rubrics in form of checklist items with weights, or grade-based components (0.0-10.0). |
|
|
|
| **Programming** | :ballot_box_with_check: | :ballot_box_with_check: | WebLab has built-in support for Java, Scala, Python and C(++) assignments and supports any other language for which a Docker image with WebLab input/output handling can be provided. Students edit their `Solution` in the WebLab editor, and can test their solution against their own `User Tests`, or against the `Specification Tests` for which the code and output are hidden to students. Course managers can provide an initial `Solution` template, `User test` template, `Library` code, and `Specification tests` from which the grade will be computed. (TODO: separate page with more details) |
|
|
|
| **File Upload** | | :ballot_box_with_check: | Similar to Essay/Open Question. Students can upload a file as submission and optionally enter textual remarks (with markup). Managers can restrict on the file types supported for upload.|
|
|
|
| **Peer-Review** | | :ballot_box_with_check: | For a peer-review assignment, the manager selects the target assignment from which submissions should get peer-reviewed by the students. Students get assigned a submission randomly from the target assignment. Reviewing is done in form of entering textual feedback by students. This feedback is not visible to the owner of the reviewed submission until the manager opens the reviews for inspection by the submission owners. The owner's name of a peer reviewed submission is hidden to the reviewer (except for name uploaded files, which are not touched by WebLab). |
|
|
|
| **File Upload** | | :ballot_box_with_check: | Similar to Essay/Open Question. Students can upload a file as submission and optionally enter textual remarks (with markup). Managers can restrict on the file types supported for upload. |
|
|
|
| **Peer-Review** | | :ballot_box_with_check: | For a peer-review assignment, the manager selects the target assignment from which submissions should get peer-reviewed by the students. Students get assigned a submission randomly from the target assignment. Reviewing is done in form of entering textual feedback by students. This feedback is not visible to the owner of the reviewed submission until the manager opens the reviews for inspection by the submission owners. The owner's name of a peer reviewed submission is hidden to the reviewer (except for name uploaded files, which are not touched by WebLab). |
|
|
|
| **Grade-Only** (externally handed in) | | :ballot_box_with_check: | Administrative only (students don't submit anything). For exercises handed in outside WebLab, the grades can be uploaded (csv format) or entered manually. This is useful when you want to have the complete course grade administration in WebLab. |
|
|
|
| **Pass/Fail** | | :ballot_box_with_check: | Administrative only (students don't submit anything). For administering things such as "performed task x", "present during lab". |
|
|
|
| **Pass/Fail** | | :ballot_box_with_check: | Administrative only (students don't submit anything). For administering things such as "performed task x", "present during lab". |
|
|
|
| **Generated Questions** (experimental) | :ballot_box_with_check: | :ballot_box_with_check: | An interface in Scala lets you define a Question Machinery with question generator and answer evaluator. The question generator returns a tuple with the question as String and an unexposed answer seed (e.g. the correct answer itself, or some identification sufficient to check a student answer for correctness). The answer evaluator takes the student answer (String) and answer seed and returns a tuple with the grade (hidden until grades are published) and textual feedback. |
|
|
|
|
|
|
#### Organizing Assignments in Folders
|
|
|
|
|
|
Assignment Folders lets you group assignments based on
|
|
|
|
|
|
- Deadline (e.g. Labs Week 1, Labs Week 2, ...)
|
|
|
- Type of exercise (e.g. Analysis, Implementation, ...)
|
|
|
- Obligatory/Optional/Practice
|
|
|
- Exams (Mid-term, Final, Resit)
|
|
|
|
|
|
You can (a) create folders, (b) reorder assignments within the folder, or (c) (re)move assignments (from)/into a folder.
|
|
|
You can (a) create folders, (b) reorder assignments within the folder, or (c) (re)move assignments (from)/into a folder.
|
|
|
|
|
|
<img src="uploads/21cb3856f09c15338e67149e3ddb674f/assignment-folders.png" width="500px" />
|
|
|
![](uploads/21cb3856f09c15338e67149e3ddb674f/assignment-folders.png)
|
|
|
|
|
|
##### Folder configuration options
|
|
|
|
|
|
The folder level provides configuration options that apply at the folder level, including:
|
|
|
|
|
|
- option to display folder assignments on single page (e.g. when asking various questions about the same topic/problem/article). Programming questions are not supported in this view
|
|
|
- [assignment visibility an deadline options](WebLab/Assignment-Visibility-and-Deadlines) (non-public/public, visible from/until)
|
|
|
- [exam access setup](WebLab/Exam-Tickets)
|
... | ... | @@ -88,7 +97,7 @@ To request plagiarism scans for coding or essay questions, notify [Weblab suppor |
|
|
|
|
|
- Click view scan for the scanned assignment:
|
|
|
|
|
|
<img src="uploads/8f4b6d811acc38718fdb39e41c5f2e1f/Screenshot_2020-09-14_at_15.47.46.png" width="500px" />
|
|
|
![](uploads/8f4b6d811acc38718fdb39e41c5f2e1f/Screenshot_2020-09-14_at_15.47.46.png)
|
|
|
|
|
|
- On the results screen you can sort entries by clicking the table headers. You can filter entries in the boxes below the table headers, typical filters are minimum size to ignore irrelevant solutions and percentage of matching fragments. At the top is a global filter that removes low percentage matches entirely to speed up the page. If there are no matches at all, it can help to lower this global filter. To review a suspicious case, click the compare link to get a side-by-side view of the compared solutions.
|
|
|
|
... | ... | @@ -96,23 +105,24 @@ To request plagiarism scans for coding or essay questions, notify [Weblab suppor |
|
|
|
|
|
## Testing as Student (Student Mode)
|
|
|
|
|
|
<img src="uploads/6a0d39b29c2019ec806121f6a0a31aa8/student-mode.png" width="500px" />
|
|
|
![](uploads/6a0d39b29c2019ec806121f6a0a31aa8/student-mode.png)
|
|
|
|
|
|
Student mode is available for course staff and allows you to view the course content the way a student would see it. This is useful for checking how course content is presented to students, or for testing an upcoming exam/assignment before it becomes available (requires Hybrid Mode)
|
|
|
|
|
|
**To use student mode:**
|
|
|
|
|
|
- Make sure you are enrolled as student for your course (i.e. check your enrolment status on the course edition's home page)
|
|
|
- At the right of the navigation bar, click Enable Student mode and choose between:
|
|
|
- Hybrid mode, in case you want to test an assignment as student, but with access to assignments not yet available
|
|
|
- Strict mode, where you see everything exactly as students see it (without exclusive access to hidden content).
|
|
|
- Hybrid mode, in case you want to test an assignment as student, but with access to assignments not yet available
|
|
|
- Strict mode, where you see everything exactly as students see it (without exclusive access to hidden content).
|
|
|
- The top bar on assignment pages will color differently to denote that you are using Student Mode.
|
|
|
- You can disable student mode again by clicking the Student Mode-label
|
|
|
|
|
|
|
|
|
### Delete your submission/start over
|
|
|
|
|
|
While testing (an exam), you might want to reset your submission as if you haven't attempted it yet. Course staff can delete their own submission from the `Submission Info` box:
|
|
|
|
|
|
- Open Submission Info
|
|
|
- Click "Open deletion page", after which you can permanently delete your submission.
|
|
|
|
|
|
<img src="uploads/31ff609f14e82191940ed59d3e1de58d/nav-delete-sub.png" width="250px"/> |
|
|
\ No newline at end of file |
|
|
![](uploads/31ff609f14e82191940ed59d3e1de58d/nav-delete-sub.png) |