# changelog

author: Tim Theisen <tim@cs.wisc.edu> - 9.0.16-1
changelog:
  - Singularity now mounts /tmp and /var/tmp under the scratch directory
  - Fix bug where Singularity jobs go on hold at the first checkpoint
  - Fix bug where gridmanager deletes the X.509 proxy file instead of the copy
  - Fix file descriptor leak when using SciTokens for authentication


author: Tim Theisen <tim@cs.wisc.edu> - 9.11.0-1
changelog:
  - Modified GPU attributes to support the new 'require_gpus' submit command
  - Add (PREEMPT|HOLD)_IF_DISK_EXCEEDED configuration templates
  - ADVERTISE authorization levels now also provide READ authorization
  - Periodic release expressions no longer apply to manually held jobs
  - If a #! interpreter doesn't exist, a proper hold and log message appears
  - Can now set the Singularity target directory with 'container_target_dir'
  - If SciToken and X.509 available, uses SciToken for arc job authentication


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.17-1
changelog:
  - Fix file descriptor leak when schedd fails to launch scheduler jobs
  - Fix failure to forward batch grid universe job's refreshed X.509 proxy
  - Fix DAGMan failure when the DONE keyword appeared in the JOB line
  - Fix HTCondor's handling of extremely large UIDs on Linux
  - Fix bug where OAUTH tokens lose their scope and audience upon refresh
  - Support for Apptainer in addition to Singularity


author: Tim Theisen <tim@cs.wisc.edu> - 9.12.0-1
changelog:
  - Provide a mechanism to bootstrap secure authentication within a pool
  - Add the ability to define submit templates
  - Administrators can now extend the help offered by condor_submit
  - Add DAGMan ClassAd attributes to record more information about jobs
  - On Linux, advertise the x86_64 micro-architecture in a slot attribute
  - Added -drain option to condor_off and condor_restart
  - Administrators can now set the shared memory size for Docker jobs
  - Multiple improvements to condor_adstash
  - HAD daemons now use SHA-256 checksums by default


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.0-1
changelog:
  - Users can prevent runaway jobs by specifying an allowed duration
  - Able to extend submit commands and create job submit templates
  - Initial implementation of htcondor <noun> <verb> command line interface
  - Initial implementation of Job Sets in the htcondor CLI tool
  - Add Container Universe
  - Support for heterogeneous GPUs
  - Improved File transfer error reporting
  - GSI Authentication method has been removed
  - HTCondor now utilizes ARC-CE's REST interface
  - Support for ARM and PowerPC for Enterprise Linux 8
  - For IDTOKENS, signing key not required on every execution point
  - Trust on first use ability for SSL connections
  - Improvements against replay attacks


author: Tim Theisen <tim@cs.wisc.edu> - 10.1.1-1
changelog:
  - Improvements to job hooks and the ability to save stderr from a job hook
  - Fix bug where Apptainer only systems couldn't run with Docker style images


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.1-1
changelog:
  - Add Ubuntu 22.04 (Jammy Jellyfish) support
  - Add file transfer plugin that supports stash:// and osdf:// URLs
  - Fix bug where cgroup memory limits were not enforced on Debian and Ubuntu
  - Fix bug where forcibly removing DAG jobs could crash the condor_schedd
  - Fix bug where Docker repository images cannot be run under Singularity
  - Fix issue where blahp scripts were missing on Debian and Ubuntu platforms
  - Fix bug where curl file transfer plugins would fail on Enterprise Linux 8


author: Tim Theisen <tim@cs.wisc.edu> - 10.2.0-1
changelog:
  - Preliminary support for Enterprise Linux 9
  - Preliminary support for cgroups v2
  - Can now set minimum floor for number of CPUs that a submitter gets
  - Improved validity testing of Singularity/Apptainer runtinme
  - Improvements to jobs hooks, including new PREPARE_JOB_BEFORE_TRANSFER hook
  - OpenCL jobs now work inside Singularity, if OpenCL drivers are on the host


author: Tim Theisen <tim@cs.wisc.edu> - 10.2.1-1
changelog:
  - Improved condor_schedd scalability when a user runs more than 1,000 jobs
  - condor_ssh_to_job should always work in glidein environments
  - The Python Schedd.query() always returns the ServerTime attribute
  - Fixed issue that prevented HTCondor installation on Ubuntu 18.04


author: Tim Theisen <tim@cs.wisc.edu> - 10.2.1-1
changelog:
  - Improved condor_schedd scalability when a user runs more than 1,000 jobs
  - Fix issue where condor_ssh_to_job fails if the user is not in /etc/passwd
  - The Python Schedd.query() now returns the ServerTime attribute
  - Fixed issue that prevented HTCondor installation on Ubuntu 18.04


author: John Knoeller <johnkn@cs.wisc.edu> - 10.0.2-1
changelog:
  - HTCondor can optionally create intermediate directories for output files
  - Improved condor_schedd scalability when a user runs more than 1,000 jobs
  - Fix issue where condor_ssh_to_job fails if the user is not in /etc/passwd
  - The Python Schedd.query() now returns the ServerTime attribute for Fifemon
  - VM Universe jobs pass through the host CPU model to support newer kernels
  - HTCondor Python wheel is now available for Python 3.11
  - Fix issue that prevented HTCondor installation on Ubuntu 18.04


author: Tim Theisen <tim@cs.wisc.edu> - 10.3.0-1
changelog:
  - Now evicts OOM killed jobs when they are under their requested memory
  - HTCondor glideins can now use cgroups if one has been prepared
  - Can write job information in an AP history file for each execution attempt
  - Can now specify a lifetime for condor_gangliad metrics
  - The condor_schedd now advertises a count of unmaterialized jobs


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.3-1
changelog:
  - GPU metrics continues to be reported after the startd is reconfigured
  - Fixed issue where GPU metrics could be wildly over-reported
  - Fixed issue that kept jobs from running when installed on Debian or Ubuntu
  - Fixed DAGMan problem when retrying a proc failure in a multi-proc node


author: Tim Theisen <tim@cs.wisc.edu> - 10.4.0-1
changelog:
  - DAGMan no longer carries the entire environment into the DAGMan job
  - Allows EGI CheckIn tokens to be used the with SciTokens authentication


author: Tim Theisen <tim@cs.wisc.edu> - 10.4.2-1
changelog:
  - Fix bug where remote submission of batch grid universe jobs fail
  - Fix bug where HTCondor-CE fails to handle jobs after HTCondor restarts


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.4-1
changelog:
  - Provides script to assist updating from HTCondor version 9 to version 10
  - Fixes a bug where rarely an output file would not be transferred back
  - Fixes counting of submitted jobs, so MAX_JOBS_SUBMITTED works correctly
  - Fixes SSL Authentication failure when PRIVATE_NETWORK_NAME was set
  - Fixes rare crash when SSL or SCITOKENS authentication was attempted
  - Can allow client to present an X.509 proxy during SSL authentication
  - Fixes issue where a users jobs were ignored by the HTCondor-CE on restart
  - Fixes issues where some events that HTCondor-CE depends on were missing


author: Tim Theisen <tim@cs.wisc.edu> - 10.5.0-1
changelog:
  - Can now define DAGMan save points to be able to rerun DAGs from there
  - Expand default list of environment variables passed to the DAGMan manager
  - Administrators can prevent users using "getenv = true" in submit files
  - Improved throughput when submitting a large number of ARC-CE jobs
  - Execute events contain the slot name, sandbox path, resource quantities
  - Can add attributes of the execution point to be recorded in the user log
  - Enhanced condor_transform_ads tool to ease offline job transform testing
  - Fixed a bug where memory limits over 2 GiB might not be correctly enforced


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.5-1
changelog:
  - Rename upgrade9to10checks.py script to condor_upgrade_check
  - Fix spurious warning from condor_upgrade_check about regexes with spaces


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.18-1
changelog:
  - Can configure clients to present an X.509 proxy during SSL authentication
  - Provides script to assist updating from HTCondor version 9 to version 10


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.6-1
changelog:
  - In SSL Authentication, use the identity instead of the X.509 proxy subject
  - Can use environment variable to locate the client's SSL X.509 credential
  - ClassAd aggregate functions now tolerate undefined values
  - Fix Python binding bug where accounting ads were omitted from the result
  - The Python bindings now properly report the HTCondor version
  - remote_initial_dir works when submitting a grid batch job remotely via ssh
  - Add a ClassAd stringlist subset match function


author: Tim Theisen <tim@cs.wisc.edu> - 10.6.0-1
changelog:
  - Administrators can enable and disable job submission for a specific user
  - Work around memory leak in libcurl on EL7 when using the ARC-CE GAHP
  - Container images may now be transferred via a file transfer plugin
  - Add ClassAd stringlist subset match function
  - Add submit file macro '$(JobId)' which expands to full ID of the job
  - The job's executable is no longer renamed to 'condor_exec.exe'


author: Tim Theisen <tim@cs.wisc.edu> - 10.0.7-1
changelog:
  - Fixed bug where held condor cron jobs would never run when released
  - Improved daemon IDTOKENS logging to make useful messages more prominent
  - Remove limit on certificate chain length in SSL authentication
  - condor_config_val -summary now works with a remote configuration query
  - Prints detailed message when condor_remote_cluster fails to fetch a URL
  - Improvements to condor_preen


author: Tim Theisen <tim@cs.wisc.edu> - 10.7.0-1
changelog:
  - Support for Debian 12 (Bookworm)
  - Can run defrag daemons with different policies on distinct sets of nodes
  - Added want_io_proxy submit command
  - Apptainer is now included in the HTCondor tarballs
  - Fix 10.5.0 bug where reported CPU time is very low when using cgroups v1
  - Fix 10.5.0 bug where .job.ad and .machine.ad were missing for local jobs


