News
| Due to COVID-19 pandemic, we are organizing LTB 2020 Workshop as a live event on April 20, 10:00 - 15:00 EDT (Eastern Daylight Time)
equivalent to 08:00 - 13:00 MDT (Edmonton time).
If you wish to join, please do register in advance. By registration, you will be invited to the workshop Slack
channel, in which you will be able to join live keynotes, expernetial and paper talks.
[Registration]
|
Workshop Agenda
Live Sessions:
| 09:50 - 10:00 EDT
| [Chairs]
| Setup, Welcome and Introduction.
[Talk] — [Slide]
|
|
|
|
|
| 10:00 - 11:00 EDT
| [Keynote]
|
Alexandru Iosup, Vrije Universiteit Amsterdam. Will It Rain Today? Understanding the
Weather of Computing Clouds, Before it Happens.
[Talk] — [Slide]
|
|
|
|
|
| 11:00 - 11:30 EDT
| [Experience Talk]
|
Henrik Rexed, Neotys. Performance Testing Automation for CI/CD Pipelines.
[Talk] — [Slide]
|
|
|
|
|
| 11:30 - 12:00 EDT
| [Experience Talk]
|
Boris Zibitsker and Alexander Podelko, BEZNext and Oracle. Performance Testing and
Modeling for New Applications.
[Talk] — [Slide]
|
| 12:00 - 13:00 EDT
| [Keynote]
|
Alberto Avritzer, eSulabSolutions. Integrating Automated Scalability Assessment into
DevOps.
[Talk] — [Slide]
|
| 13:00 - 13:30 EDT
| [Experience Talk]
|
David Daly, MongoDB. How to Waste Time and Money Testing the Performance of a Software
Product.
[Talk] — [Slide]
|
| 13:30 - 14:00 EDT
| [Experience Talk]
|
Gopal Brugalette, SoFi. Machine Learning Applications to the Analysis of Performance and
Load Testing Results.
[Talk] — [Slide]
|
| 14:00 - 15:00 EDT
| [Keynote]
|
Carey Williamson, University of Calgary. Things That Go Bump in the Net.
[Talk] — [Slide]
|
Offline:
| Pre Recorded
| [Research Paper]
|
Dheeraj Chahal and Ravi Ojha, TCS Research. Migrating a Recommendation System to Cloud
Using ML Workflow.
[Talk] — [Slide]
|
Call for papers
Software systems (e.g., smartphone apps, desktop applications, telecommunication infrastructures, cloud and
enterprise systems, etc.) have strict requirements on software performance. Failure to meet these requirements
may cause business losses, customer defection, brand damage and other serious consequences. In addition to
conventional functional testing, the performance of these systems must be verified through load testing or
benchmarking to ensure quality service.
Load testing and benchmarking software systems are difficult tasks, which requires a great understanding of the
system under test and customer behavior. Practitioners face many challenges such as tooling (choosing and
implementing the testing tools), environments (software and hardware setup) and time (limited time to design,
test, and analyze). This one-day workshop brings together software testing researchers, practitioners and tool
developers to discuss the challenges and opportunities of conducting research on load testing and benchmarking
software systems.
We solicit two tracks of submissions: research papers (maximum 4 pages), presentation track for industry or
experience talks (maximum 700 words extended abstract). Technical papers should follow the standard ACM SIG
proceedings format and need to be submitted electronically via EasyChair. Accepted papers
will be
published in the ICPE 2020 Proceedings. Submissions can be research papers, position papers, case studies or
experience reports addressing issues including but not limited to the following:
- Efficient and cost-effective test executions
- Rapid and scalable analysis of the measurement results
- Case studies and experience reports on load testing and benchmarking
- Leveraging cloud computing to conduct large-scale testing
- Load testing and benchmarking on emerging systems (e.g., machine learning systems, adaptive/autonomic
systems, big data batch and stream processing systems, and cloud services)
- Continuous performance testing
- Load testing and benchmarking in the context of agile software development process
- Using performance models to support load testing and benchmarking
- Building and maintaining load testing and benchmarking as a service
- Efficient test data management for load testing and benchmarking
- Context-driven performance testing
- Performance/load testing as an integral part of the performance engineering process
Important Dates
| Paper submission: |
January 20, 2020 |
| Presentation track submission: |
March 2, 2020 |
| Paper notification: |
February 8, 2020 |
| Presentation notification: |
March 9, 2020 |
| Camera ready: |
February 24, 2020 |
| Workshop date: |
April 20, 2020 |
Organization
Chairs
| Alexander Podelko |
Oracle, USA |
| Tse-Hsun (Peter) Chen |
Concordia University, Canada |
| Hamzeh Khazaei |
York University, Canada |
Program Committee
| Almeida, Eduardo Cunha de |
UFPR, Brazil |
| Beigi, Nasim |
University of Toronto, Canada |
| Bezemer, Cor-Paul |
University of Alberta, Canada |
| Brunnert, Andreas |
RETIT GmbH, Germany |
| E. Hassan, Ahmed |
Queens University, Canada |
| Jiang, Zhen Ming (Jack) |
York University, Canada |
| Lange, Klaus-Dieter |
HPE, USA |
| Litoiu, Marin |
York University, Canada |
| Krishnamurthy, Diwakar |
University of Calgary, Canada |
| Kroß, Johannes |
Fortiss, Germany |
| Sunyé, Gerson |
University of Nantes, France |
| Ventrsque, Anthony |
University College Dublin (UCD), Ireland |
Steering Committee
| E. Hassan, Ahmed |
Queen’s University, Canada |
| Litoiu, Marin |
York University, Canada |
| Jiang, Zhen Ming (Jack) |
York University, Canada |
Past LT Workshops
