Test Case Reasoning Assistant

TCRA User Guide

TCRA Graph Tool

Execution:

In Windows, use the tcra.bat file to run the tool.
In Linux, run the tcra.sh file to run the tool.

Opening an Exercise:

Choose File->Open from the menu bar. Navigate to the tcra
directory and open the exercises folder. Choose any Exercise
class file.

Usage:

In the upper-left pane you will see a tree structure listing
all the methods available for testing inside the exercise you have
chosen. Select the method you wish to test and you will see its
specification appear in the upper-right pane. Read this carefully
and then enter values for the arguments in the lower-left pane's
table. When you are finished, click the OK button to submit it for
evaluation. A message box will appear telling you if the test case
is correct, incorrect, or if some error was encountered while
reading your input values. In the lower-right pane, you will see
the specification again but with your values substituted for the
arguments.

Uploading Your Log:

TCRA monitors your tool usage and keeps a log of the exercises
you have tried. This log can be uploaded to an FTP server whos
address is set in the tcra.config file. The instructor of the
class should either provide you with a replacement file or the
settings you should enter into the file.
From the Tools menu, you can select either the on-campus or
off-campus server to use and then select "Upload Log". You will
be prompted for your username and password which will be
transmitted via an SSH connection for authentication. The log
will then be uploaded to the server, overwritting your previously
uploaded log.

Known Bugs:

  1. The window's components do not resize when you maximize the
    window.
  2. In a Windows environment, when you manually resize the window,
    the components do not automatically resize. If you click a
    window edge once more, they will resize.
  3. If the FTP server is unreachable for whatever reason, the tool will hang as the SSH connection continuously tries to connect. The process must be killed to stop the program.

Installation:

The graph tool requires Gnuplot 4.2 available here.
In a Windows environment, Gnuplot should be installed to C:\gnuplot. In Linux, the gnuplot executable should be available upon installation.

Execution:

In Windows, use the graph.bat file to run the tool.
In Linux, run the graph.sh file to run the tool.

Downloading Logs:

From under the Tools menu, you can select whether to download
from the on-campus or off-campus server. The server addresses can
be configured in the tcra.config file along with the directory
where the student logs will be stored. After selecting which
address to use, select "Download Logs" and you will be prompted
for your username and password. The logs will then be downloaded
to the current working directory in a folder with the current
date as the name. This is to provide a running record of student
logs for grades, student improvement, or other research
possibilities.

Usage:

Beginning at the top of the screen, click the "Choose Files"
button. Navigate to where the student logs are stored and select
one or more logs you wish to generate graphs for. This will then
load the next table with the exercises available in the files.
Select one or more exercises and hit the "Choose Exercises"
button. This will load the next table with the method contracts
that have test cases in the logs. Select one or more methods you
wish to graph and enter a date range below in the format specified.

Graph Options:

  • Aggregate Results per Method: One graph per method will be generated with students along the x-axis.
  • Individual Results per Method: One graph per student will be generated with methods along the x-axis.
  • Aggregate Results for All Methods: One graph is generated with methods along the x-axis.
  • All Graphs: Generate all of the above graphs

Known Bugs:

  1. If the FTP server is unreachable for whatever reason, the tool will hang as the SSH connection continuously tries to connect. The process must be killed to stop the program.