Chutzpah Test Adapter for the Test Explorer

Free

Chutzpah adapter for the Visual Studio Unit Test Explorer. Chutzpah is an open source JavaScript test runner which enables you to run JavaScript unit tests from the command line and from inside of Visual Studio.

(15) Review
Visual Studio
2013, 2012
Download (44,752)
5/16/2014
3.2.2
View
E-mail Twitter del.icio.us Digg Facebook
Add to favorites
Description
Reviews (15)
Q and A (12)
Sign in to write a review
Sort by:

by Jovica Milenovic | Sun 10:39 AM

VS2012 (Update 4):
Test fails in Testexplorer but succeeds in "In-Browser-Test" using QUnit.

http://jsfiddle.net/legends77/8E8Ls/1/

Matthew Manela Sun 3:09 PM
| Edit |
Delete

This is a bug in the version of QUnit chutzpah uses. I just commited a change to rev to the next version (https://chutzpah.codeplex.com/SourceControl/changeset/360a23f199f2ba8c08167986d20a54344ee13a1d).

by davidG of Elecuter | June 10 2014

Unfortunately, the plug-in simply doesn't work, with no tests or test projects showing up in the test explorer :(

Matthew Manela June 17 2014
| Edit |
Delete

Sorry it is not working for you. That usually means you have not configured Chutzpah correctly for your tests. Please file a repro on chutzpah.codeplex.com and I can help with that.

by Benoit P | June 02 2014

Combined with the Chutzpah Test Runner Context Menu Extension this extension is, for me, the best solution available now for javascript TDD with Visual Studio (http://bit.ly/T64eqS)

by Marcos Gallardo | May 28 2014

Awesome tool!
But it doesn't work on VS 2013 Update 2

Matthew Manela May 29 2014
| Edit |
Delete

It works for me fine in update 2. If you have a specific issue please file it with a repro at chutzpah.codeplex.com

by heikeMind | April 03 2013

I like the plugin on my local development environment. But it has been a huge problem on setting up TFS with chutzpah in typescript. I have not able to fix an issue in the issue tracker almost a month: http://chutzpah.codeplex.com/workitem/98

I also not sure whether it is the only problem I faced unless I can solve it and move forward.
Also the blog for setting up TFS with chutzpah is outdated. The dll files are not matched. So I am also wonder whether I am doing a right by following the blog. Thanks.

by MatthewBlott | March 29 2013

I've ranked this two stars which is a bit generous but I did have it working at some point a while ago. I've tried to install several times and have now rebuilt my machine and still no joy. I have posted a question on StackOverflow but, alas, not a single answer yet. I do a lot of JavaScript these days and this would be a real help but I'm wondering whether it's worth ditching VS and moving to WebStorm and a Mac environment.

Matthew Manela March 29 2013
| Edit |
Delete

Sorry that you are running into issues. I responded a few days ago on your StackOverflow post asking if you could file a bug on chutzpah.codeplex.com and attach a zip file which contains a repro. That would help me track and diagnose your issue.

Thanks,
-Matt

by OsirisTerje | February 03 2013

by Ruezaki | December 25 2012

by Konstantin Tarkus | December 24 2012

Great job! Keep it going.

by Mads Kristensen | November 28 2012

by Shimmy Weitzhandler | October 28 2012

+5 for the name!!!

by Andre123456 | September 02 2012

I had to add the following to the extension.vsixmanifest in Chutzpah.VS2012.vsix, to get it to install in VS Express:
<InstallationTarget Version="[11.0,12.0)" Id="Microsoft.VisualStudio.VWDExpress" />

Matthew Manela September 10 2012
| Edit |
Delete

3rd party extensions aren't support in the express skus. So this is by design. Even if you mark Chutzpah as supporting VWDExpress it still won't work.

by David Wesst | May 10 2012

Works just like it should, even if its in beta I wouldn't know. Using it with Jasmine tests.

Thanks!

by Vicenç García | April 05 2012

Great job!

by Steven Wilssens MSFT | March 01 2012

Sign in to start a discussion


  • Chutzpah and mocha.js
    2 Posts | Last post July 21, 2014
    • Hey there,
      I am using visual studio 2013 ultimate.
      
      I am having issues setting up Chutzpah successfully. Interestingly, I have seen it work at times, without any modifications on my part to get it to work. Other times it will just timeout. Most of the times it will timeout.
      
      I tried to follow along and add the following references and try to run the following simple test:
      /// <reference path="mocha.js" />
      /// <reference path="c:\scripts\chai.js" />
       
      var expect = chai.expect;
       
      it("A basic test", function() {
          expect(true).to.be.ok;
          var value = "hello";
          expect(value).to.equal("hello");
      });
      
      What am I doing wrong?
      
      
    • Could you file an issue on Chutzpah.codeplex.com and attach a zip containing a full repro?
  • Change to use older version of Jasmine
    2 Posts | Last post April 28, 2014
    • We have written our unit tests in Jasmine 1.3.1, then some time after updated to the latest Chutzpah (using Jasmine 2.0) and now all the tests with spies fail. We do not want to have to go through hundreds of tests and update them. Is there any way to configure Chutzpah to use older version of Jasmine? Thanks.
    • https://chutzpah.codeplex.com/wikipage?title=jasmineVersion&referringTitle=Documentation
  • Not seeing tests
    8 Posts | Last post March 17, 2014
    • When QUnit tests are not being detected, either in HTML or JS, what is a good way to troubleshoot why?
    • What issue are you seeing? 
    • This seems to happen quite a bit, I've noticed. At my company, it seems to be a coin toss on whether installing Chutzpah will actually show our tests in Test Explorer. Works for some but not for others. I'm currently running version 2.5.0 on VS 2012 Update 4 and haven't gotten it to work. Not sure if these matter, but also installed are Chutzpah Context Menu Extension 2.5.0, TypeScript 0.9.1.1, and Web Essentials 2.9. We are using QUnit tests in TypeScript files.
    • If you could file an issue on chutzpah.codeplex.com with a zip that will (at least occasionally) repro your issue I can test locally.
    • Hi. We have just installed Chutzpah and are having the same issue - test explorer is not showing any results but Output is. Is there a resolution for this?
      
      Thanks
    • Ok, that was easy! Uninstalled, closed Visual Studio, reinstalled and it worked.
      
      Thanks
      Simon
    • Hi Matthew,
      
      I installed the Chutzpah Test Adapter for the Test Explorer and the Test Runner Context Menu Extension, running with Jasmine 2.0, VS2013.
      
      The Context Menu Extension works fine, and I get the results on the output window, however my Test Explorer doesn't show any results at all. Test is written in Typescript.
    • ========== Load Playlist finished (0:00:00.005) ==========
      ------ Discover test started ------
      Error: Timeout occured when executing test file
      While Running:d:\testing\dev\test.web.typescript.unit\tests\calculator.ts
      
      ========== Discover test finished: 0 found (0:00:24.624) ==========
  • feature request: test on save
    2 Posts | Last post October 07, 2013
    • right now i can make all tests run on save if i set the test explorer to "run on build".
      
      i want to be able to run all the JS test whenever a JS file is saved.
    • So you want when *any* JS file is saved to run all tests? This is possible but not implemented in Chutzpah. Ideally, Chutzpah would know when you changed any file that matters for your tests but I could look into adding a setting to do what you want. Can you file a work item at chutzpah.codeplex.com to track this feature?
  • Qunit or JS Code coverage
    2 Posts | Last post August 08, 2013
    • i have run below command on command prompt for code coverage but i am getting below error. 
      
      C:\Tools\Chutzpah.2.4.3>chutzpah.console.exe /coverage /path C:\Build\Dev\Solutions**.js 
      Chutzpah console test runner (64-bit .NET 4.0.30319.17929) 
      Copyright (C) 2013 Matthew Manela (http://matthewmanela.com). 
      
      chutzpah.dll: Version 2.4.3.281 
      
      System.AggregateException: One or more errors occurred. ---> System.ArgumentException: Illegal characters in path. 
      at System.IO.Path.CheckInvalidPathChars(String path, Boolean checkAdditional) 
      at System.Security.Permissions.FileIOPermission.AddPathList(FileIOPermissionAccess access, AccessControlActions control, String[] pathListOrig, Boolean checkForDuplicates, Boolean needFullPath, Boolean copyPathList) 
      at System.IO.Path.GetFullPath(String path) 
      at Chutzpah.FileProbe.FindPath(String path, Predicate1 pathExists) in c:\Dev\chutzpah\Chutzpah\FileProbe.cs:line 171 
      at Chutzpah.FileProbe.GetPathInfo(String path) in c:\Dev\chutzpah\Chutzpah\FileProbe.cs:line 133 
      at Chutzpah.FileProbe.<FindScriptFiles>d__4.MoveNext() in c:\Dev\chutzpah\Chutzpah\FileProbe.cs:line 98 
      at System.Collections.Concurrent.Partitioner.DynamicPartitionerForIEnumerable1.InternalPartitionEnumerable.GrabChunk_Buffered(KeyValuePair2[] destArray, Int32 requestedChunkSize, Int32& actualNumElementsGrabbed) 
      at System.Collections.Concurrent.Partitioner.DynamicPartitionEnumerator_Abstract2.MoveNext() 
      at System.Threading.Tasks.Parallel.<>c__DisplayClass322.<PartitionerForEachWorker>b__30() 
      at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask) 
      at System.Threading.Tasks.Task.<>c__DisplayClass10.<ExecuteSelfReplicating>b__f(Object param0) 
      
    • Could you create a work item on chutzpah.codeplex.com and upload a repro of this issue?
  • Chaijs; Automatic tests
    4 Posts | Last post August 07, 2013
    • Hi, thanks for your work, I have 2 questions:
      
      #1: currently I'm using Chai (chaijs.com) with Mocha for tests (BDD "should" style; mostly in-browser for some reasons). Is there a chance to make them working using your adapter or should I rewrite them to Jasmine/QUnit?
      
      #2: is it possible to automate these test in VS (immediately after source file modification)?
    • #1: Chutzpah doesn't support Mocha yet. This would be a nice addition but I probably won't get to it for a while. You can file an issue for this on chutzpah.codeplex.com so we can track it. You can use ChaiJS though with QUnit or Jasmine.
      
      #2: Yes you can, in the Unit Test Explorer you can check the "Run Tests after Build" toggle. Even though it says "after build" for Chutzpah this will mean each time you save your test file.
    • +1 for Mocha. Mocha allows you to use any assertion library (QUnit and Jasmine don't) and async test writing in Mocha is an order of magnitude simplier than the other two.
    • I agree.  That is precisely why I chose Mocha over QUnit and Jasmine.  I needed better support for async tests and I wanted to be able to choose my own assertion library.  
      
      +1 for Moch support.  
  • Automatically run code coverage in TFS build
    2 Posts | Last post July 23, 2013
    • Hi, 
      
      I have integrated Chutzpah in TFS server, but is there any way to let it run code coverage while TFS build? 
      
      Another question is why it cannot generate code coverage result for .html unit test file?
    • Not currently unless you are directly invoking the exe. I can look into exposing this option as a chutzpah.json setting though. Please file a work item on chutzpah.codeplex.com
  • Tests not being run after build
    3 Posts | Last post June 19, 2013
    • I'm using Chutzpah to test some Typescript files and I have the Run Tests After Build option selected in the Test Explorer. I'm also using Web Essentials and the Compile TS on save/build options are set to true. If I save one of my test files then all of the tests are re-run but if I save any other file then the tests are not run. Any idea why not? 
      
      Thanks for making Chutzpah! Seems like a great tool.
    • From looking at your code it looks like this may be the expected behavior. Are there any work arounds that will let me run the tests whenever I save a TypeScript file. 
      
      I tried adding a reference to QUnit in one of my TS files so that chutzpah would think it was a test file but this didn't make any of the tests in the actual test files get run. I also tried adding a dummy test to one of my TS files which sort of worked but it seemed to cause some circular dependency issue and tests were run multiple times and had the wrong line numbers in the output.
    • Have you tried setting Chutzpah to run directly on the .ts files instead of on the generated .js file? There is an option in the Tools->Options->Chutzpah page.
  • Headless browser
    3 Posts | Last post May 29, 2013
    • First I must say, nice work!
      
      However, I can't get the Test Adapter to run headless through using phantom.js.
      I've installed the NuGet-package for phantom.js and headless jasmine.js, but it still opens the jasmine side in the browser (not displaying anything).
      
      I can't find any options for this - the "test explorer" however runs headless, but do not have as much feedback as the "unit test sessions"-tab.
    • I found a setting for which browser to use under Resharper -> Options (so I guess you need resharper?)
    • I am not really following what you are asking. Chutzpah has nothing to do with Resharper. 
      
      What exactly are did you try to do? It might be better to move your questions to chutzpah.codeplex.com.
  • Unit test issue of Metro app with Chutzpah
    2 Posts | Last post January 04, 2013
    • We are trying to do unit test of our Metro app developed with javascript; we use WinJS.xx and Windows.xx in our js file, when we try to do unit test with Chutzpah, the following error is thrown out.
      "JS Error: ReferenceError: Can't find variable: WinJS"
      
    • Chutzpah doesn't support running WinJS unit tests yet. This is an area I am still investigating.
1 - 10 of 12 Items